[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[ddlm-group] Treatment of CIF2 unicode characters with CIF1equivalents

  • To: ddlm-group <ddlm-group@iucr.org>
  • Subject: [ddlm-group] Treatment of CIF2 unicode characters with CIF1equivalents
  • From: James Hester <jamesrhester@gmail.com>
  • Date: Mon, 24 Apr 2017 09:45:42 +1000
  • DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;h=mime-version:from:date:message-id:subject:to;bh=K9JIJJczKPy6PVjzIFqxnVP0kVDtSGAjDpe670rV1Jo=;b=gQMuq9iticRFhzop988BxusSCA7WbmkJ3UrAuyuaY4P0q1518NKP/X080C5wNTVaqATyW+36jGoZrtYDISbk+hIMSjmbS/M+UyOkUQrdugSQ8DmCHsQBgm+wY9PEDcNPlL3UVDRHpOy5Xb00lUD9z9s/AKR+QOho+94jGbCnWvZrH97Okub0aQ/0TX1Y+xm8Pw2nc/+4i3FJO8SIPyi7JGtuzgqUSDLDylnfE6RWgtAV370qrP1aafiAAhRfBQFiv8BDF/sVOX67kvwW7DGUX5hh6ZAaKL4ue9oHKrizvL6EBwcfjawKRNg7RlwrhXNqbi0P91AZtBeTrBEMzyXpEg==
Dear DDLm-group (aka COMCIFS technical committee)

There has been some lively discussion on the cif-developers mailing list of late which you may review at http://www.iucr.org/__data/iucr/lists/cif-developers/ .

One issue raised was what to do about CIF2 datavalues that contained unicode characters that have equivalent ASCII sequences described by the CIF markup conventions (e.g. Greek characters).

According to section - 17 of International Tables Vol G, by default Greek and some other non-ASCII characters can be represented in text datavalues using a backslash notation <backslash><ascii character>, e.g. \a is alpha.   Different markup conventions are possible on a per-dictionary or per-definition basis. In CIF2, these characters can be represented natively, but legacy CIF applications presented with a datavalue containing non-ASCII values may not be prepared to typeset or present them appropriately.  On the other hand, it would seem inefficient to define separate Unicode-aware datanames for every text value simply to avoid legacy problems.

Proposal: add the following paragraph to Vol G section Note that "meets the requirements of paragraph" means that this paragraph only applies in those cases for which the CIF1 markup conventions would apply. 

( Whenever an application is required to convert a datavalue from a CIF2 datafile containing code points outside the ASCII range to a datavalue containing only ASCII codepoints, the appropriate markup as per paragraphs should be substituted, provided that the relevant definition meets the requirements of paragraph If no markup is defined for the Unicode code point, no CIF1 equivalent value exists and application behaviour is undefined.

Please comment.


T +61 (02) 9717 9907
F +61 (02) 9717 3145
M +61 (04) 0249 4148
ddlm-group mailing list

Reply to: [list | sender only]