3 Fix bug. X-Path attribute expressions with spaces in them now works.
5 Fix base address for MARC output.
9 Fix bug with shadow and result set handling.
11 Implement MARCXML to ISO2709 conversion.
15 Add missing examples for Windows install.
17 Fix bug in regx filter to make it "greedy" again. This bug appeared
24 Fix XML error handling. Stop XML parse immediately if XML parse error
25 occur (i.e. produce one error only).
27 Zebra ignores "unsupported use attribute" for individual databases
28 when search multiple databases (unless all databases fail).
30 New filter grs.marcxml which works like grs.marc but produces MARCXML.
32 Added support for database deletion. It is possible to create/drop
33 a database from zebraidx utility. Note: only for isam:b.
35 Write zebrasrv.pid to lockdir.
37 Bug fix: result sets were not recovered correctly. Had to
38 add ODR handle for zebra_search_RPN in order to make it work.
40 Fixed a bug in regx filters that didn't do anchors (^) correctly.
42 Fixed a bug in searches with X-Path searches sometimes giving "extra"
45 Zebra server checks for zebrasrv.pid and refuses to start if it is already
46 locked by another (running) zebrasrv.
48 Fixed a bug with text being chunked in pieces for the grs.xml filter.
52 xelm code updates. xelm works regardless state of 'xpath enable/disable'
53 Avoid -L/usr/lib since that is already default library path.
55 Allow multiple updates within one transaction.
57 Fixed a bug with >2GB files (overflow in integer expression).
61 Fix linker error for Perl module.
63 Fix bug in and operation which in some cases could result in "extra"
64 hits. Bug was introduced in 1.3.5.
66 Fix bug in handling of schema conversion when producing numeric tags.
72 Add missing files doc/zvrank.txt and doc/marc_indexing.xml.
76 Zvrank: an experimental ranking algorithm. See doc/zvrank.txt and
77 source in index/zvrank.c. Enable this by using rank: zvrank in zebra.cfg.
78 Contributed by Johannes Leveling <Johannes.Leveling at fernuni-hagen.de>
80 livrank: another experimental ranking algorithm. Source in livcode.c.
81 Enable this by using rank: livrank in zebra.cfg and use -DLIV_CODE=1
83 Contributed by Pete Mallinson, University of Liverpool.
85 Advanced MARC indexing. See doc/marc_indexing.xml
86 Oleg Kolobov <oleg at lib.tpu.ru>
88 Perl API updates and fixes.
89 Peter Popovics <pop at technomat.hu>
91 Fixed 'zebraidx delete'.
93 Implemented 'zebraidx clean'.
95 64-bit offsets for register files on WIN32 (no 2 GB limit).
97 Fixed a few memory leaks WRT sorting.
101 Fixed error handling : error code was not properly returned.
103 Support Truncation 104 (CCL).
107 Added missing source files for perl extension.
111 Implemented xelm directive.
113 Updated for newer version of YAZ (introduction of string schema).
115 Directory examples/zthes now part of distribution (was missing
116 in previous release).
118 New .abs directive, systag, that control where to put retrieval
119 information. The directive takes two arguments: system tag, element name.
120 System tag is one of : rank, sysno, size.
124 Perl Filter and Perl API. By Peter Popovics.
126 For zebra.cfg, if no profilePath is specified, directory
127 (prefix)/share/idzebra/tab
130 Zebra Examples in examples . Zebra tests in test.
132 Bug fix: sort index was not properly modified on
133 record updates/deletes.
135 Fix handling of character entities for sgml filter.
137 Move data1 to Zebra (used to be part of YAZ).
141 Fix character encoding of scan response terms.
143 Fix character decoding of scan request terms.
145 Fix ESpec handling (requires YAZ 1.9.1)
147 Fix searches for complete fields.
151 When name zebra is used in a filename or directory 'idzebra' is used
152 instead to avoid confusion with GNU zebra (routing software).
154 Zebra server stops with a fatal error if config file cannot be read.
156 New config setting, followLinks, that controls whether update of files
157 should follow symbolic. Set it to 1 (for enable) or 0 (to disable).
158 By default symbolic links are followed.
160 Fix MARC transfer . MARC fields had wrong data for multiple fields.
162 XML record reader moved from YAZ to Zebra, to make YAZ less
163 dependant on external libraries.
165 Zebra uses yaz_iconv which is mini iconv library supporting UTF-8,
166 UCS4, ISO-8859-1. This means that Zebra does UNICODE even
167 on systems that doesn't offer iconv.
169 XML record reader supports external system entities.
173 New .abs-directive "xpath" that takes one argument: "enable"
174 or "disable" to enable and disable XPath -indexing. If no "xpath"
175 direcive is found in .abs-file , XPath-indexing is disabled to ensure
176 backwards compatibility. For missing .abs-files XPath-indexing is
177 enabled so that such records are searchable.
179 Zebra warns about missing .abs-file only once (for each type).
181 Fixed a bug in file update where already-inserted files could
186 Zebra license changed to GNU GPL.
188 XPath-like queries used when RPN string attributes are used, eg.
189 @attr 1=/portal/title sometitle
190 @attr 1=/portal/title[@xml:lang=da] danishtitle
191 @attr 1=/portal/title/@xml:lang da
192 @attr 1=//title sometitle
194 Zebra uses UTF-8 internally:
195 1) New setting "encoding" for zebra.cfg that specifies encoding for
196 OCTET terms in queries and record encoding for most transfer syntaxes
197 (except those that use International Strings, such as GRS-1).
198 2) The encoding of International strings is UTF-8 by default. It
199 may be changed by character set negotiation. If character set
200 negotiation is in effect and if records are selected for conversion
201 these'll be converted to the selected character set - thus overriding
202 the encoding setting in zebra.cfg.
203 3) New directive "encoding" in .abs-files. This specifies the external
204 character encoding for files indexed by zebra. However, if records
205 themselves have an XML header that specifies and encoding that'll be used
208 XML filter (-t grs.xml).
210 Multiple registers. New setting in resource 'root' that holds base
211 directory for register(s). A group a databases may be put in separate
212 register in directory root/reg by using db name 'reg/db1' ... 'reg/dbN'.
216 Fixes for Digital Unix
218 Implemented hits per term using USR:SearchResult-1.
220 New Zebra API. Locking system re-implemented.
222 --- 1.1.stable 2002/02/20
224 Rank weight can be controlled with attribute type 9. Default
225 value is 34. Recommended values between 1-36.
229 Updated for YAZ version 1.8.
231 Added support for termsets - a result set of terms matching
232 a given query. For @attr 8=<set> creates termset named <set>.
234 Added support for raw retrieval. Element Set Name R forces the
235 text filter which returns the record in its original form.
237 Added numerical sort - triggered by structure=numeric (4=109).
239 Remote record import using Z39.50 Extended Services and Segments.
241 Fixed bug where updating a database with user-defined attributes
242 could corrupt the register (bad storeKeys).
244 Multi-threaded version.
246 Fixed bug regarding proximity.
248 Documentation updates.
250 Fixed bug in record retrieval module that occured on 64-bit OSF
255 Fixed bug in makefile for WIN32.
257 Fixed bug in configure script - used bash-specific features.
261 Added support for multiple records in one file for filter grs.sgml.
263 Changed record index structure. New layout is incompatible with
264 previous releases. Added setting "recordcompression" to control
265 compression of records. Possible values are "none" (no
266 compression) and bzip2 (compression using libbz2).
268 Added XML transfer syntax support for retrieval of structured records.
269 Schema in CompSpec is recognised in retrieval of structured records.
271 Changed Tcl record filter so that it attemps to read <filt>.tflt. If
272 that fails, the filter reads the file <filt>.flt (regx style filter).
274 Implemented new Tcl record filter - use grs.tcl.<filter> to enable it.
275 Zebra's configure script automatically attempts to locate Tcl. For
276 manual Tcl configuration use option --with-tclconfig=<path> to specify
277 where Tcl's library files are located.
279 Implemented "compression" of Dictionary and ISAM system. Dictionary
282 Added "tagsysno" directive to zebra.cfg to control under which tag the
283 system ID is placed. Use tagsysno: 0 to disable Zebra's system number
286 Added "tagrank" as above.
288 Changed file naming scheme for register files from <name>.mf.<no> to
291 Implemented "position"-flag for register type (as defined in
292 default.idx). When set to zero no position (or seqence number) is
293 saved in register for each word occurrence, thus saving some register
296 Implemented database mapping. Using mapdb one can specify a database
297 to be mapped to one or more physical databases. Usage:
298 mapdb <fromdb> <todb> ..
300 Added SOIF-filter. Thanks to Peter Valkenburg.
302 For the regx-filter "end element -record" may trigger a mark-of-record
303 if outer level is reached.
305 Tag sets may be typed in the reference to it. From the .abs-file the
306 "tagset" directive takes a third optional integer type for the tag set
307 referenced. From a .tag-file the "include" directive takes a third
308 optional type as well. The old "type" directive in the tag set itself
309 is still recognized but acts as the default type for the tag set.
311 Zebra supports the specification of arbitrary attributes sets, schemas
312 and tag sets, because of the change in YAZ' OID management system.
314 Fixed bug in Sort that caused it NOT to use character mapping as it
317 Zebra now uses GNU configure to generate Makefile(s).
319 Added un-optimised support for left and left/right truncation attributes.
321 Added support for relational operators on text when using RPN queries.
323 Added support for sort specifications in RPN queries. Type 7 specifies
324 'sort' where value 1=ascending, value 2=descending. The use attribute
325 specifies the field criteria as usual. The term specifies priority
326 where 0=first, 1=second, ...
328 Changed the way use attributes are specified in the recordId
331 Maximum number of databases in one Zebra register increased.
333 New setting, databasePath, which specifies that first directory during
334 update traversal is the database name (instead of a fixed one).
336 New setting, explainDatabase, which specifies that databases are
339 Modified Zebra so that it works with ASN.1 compiled code for YAZ.
341 Implemented EXPLAIN database maintenance. Zebra automatically
342 generate - and update CategoryList, TargetInfo, DatabaseInfo,
343 AttributeSetInfo and AttributeDetails records at this stage. The
344 records may be transferred as GRS-1, SUTRS or Explain.
346 Fixed register spec so that colon isn't treated as size separator
347 unless followed by [0-9+-] in order to allow DOS drive specifications.
349 Fixed two bugs in ISAMC system.
351 Changed the way Zebra keeps its maintenance information about attribute
352 sets, available attributes, etc.. Records in "SGML" notation using an
353 EXPLAIN schema is now used when appropriate.
355 Bug fix: Index didn't handle update/insert/delete of the same record
356 (i.e. same recordId) in one run (one invocation of zebraidx). Only the
357 first occurence of a record is considered.
359 Most searches now return correct number of hits.
361 New modular ranking system. Interested programmers are encouraged to
362 inspect rank1.c and improve the algorithm.
364 Bug fix: Lock files weren't removed as they should on NT.
366 Implemented Z39.50 Sort. Zebra's sort handler uses use attributes to
367 specify a "sort register". Refer to the gils sample records which refer
368 to index type "s" which is specified as "sort" in the default.idx file.
369 Each sort criteria can either be Ascending or Descending and at most
370 three sort elements can be specified.
372 Bug fix: Character mapping didn't work for text files.
376 Simple ranked searches now return correct number of hits.
378 The test option (-s) only makes a read-lock on the index as well
379 as using read-only operations anywhere.
381 Moved towards generic character mapping. Configuration file default.idx
382 specifies character map files for register types w, p, u, etc.
384 Implemented "begin variant" for the sgml.regx - filter.
386 Fixed a few memory leaks.
388 Added support for C++, headers uses extern "C" for public definitions.
390 Bug fix: The show records facility (-s) only displayed information for
391 the first record in a file (and not for every record in the file).
393 Added option "-f <n>" to limit the logging of record operations. After
394 <n> records has been processed no logging is performed (unless errors
397 Bug fix: the compressed ISAM system didn't handle update operations
400 Added setting, "maxResultSetSize", to hold the number of records to
401 save in a result set.
403 Bug fix: Complete phrase did't work for search operations.
405 Bug fix: temporary result sets weren't deleted.
407 Reduced disk space for saved keys (storeKeys = 1).
409 Added optional, physical ANY (key replication)
411 Implemented proximity operator in search.
413 Bug fix: the path name buffers used by file match traversal routines
414 have been extended to support long file names.
416 New C(ompressed) ISAM system. To enable it, specify "isam: c" in the
417 configuration file. The resulting register without "storeKeys" is about
418 half the size, and the memory used by zebraidx during phase 2 (merge) is
419 reduced to a minimum.
421 Reworked the way Regexp-2 queries with error tolerance are handled and
422 specified. The documentation has been updated accordingly.
424 Bug fix: Zebrasrv didn't search correctly when queries contained masking
425 characters. This bug was introduced in 1.0a8.
427 Zebrasrv now tag records with the proper database name.
429 New settings, memMax and keyTmpDir.
431 Changed name of setting lockDir (previously called lockPath) and
432 setTmpDir (previously called tempSetPath).
434 Generalized and changed record type specifications. In short, there are:
436 grs.sgml structured, "SGML-like" syntax
437 grs.regx.<filter> structured, Regular expression filter
438 grs.marc.<abs> Reads *MARC records in the ISO2709 format. <abs>
439 is the name of an abstract syntax file.
440 Bug fix: Result sets weren't sorted in operations involving boolean
441 operations with "ranked" operands.
445 Added national character-handling subsystem.
449 Small modifications to input filters and profiles.
451 Added support for SOIF syntax (with private OID).
455 Fixed buffer-size problem in indexing.
457 Added compression to temporary files for updating.
459 Added phrase registers.
461 Added dynamic mapping of search attribute to multiple termlists (ANY).
463 Scan support in multiple databases/registers.
465 Configuration settings are case-insensitive and single dash (-)
466 characters are ignored in comparisons.
468 The index processing ignores empty files - warning given.
470 New option to zebraidx (-V) displays version information.
474 Fixed problem in file-update system.
476 Fixed problem in shadow system; register was sometimes corrupted after
481 Fixed problems in the ISAM subsystem. Caused difficulties when updating
484 Fixed small problem in SUTRS-filter. A newline was sometimes inserted before
485 the rank and record number.
487 Fixed bug in the isam subsystem - caused a malfunction when accessing
488 words which occurred more than 10000 times.
490 Distribution should now include YAZ (Z39.50 protocol stack) to simplify
493 Server can now run under inetd. Use option -i, and -w <directory> to
494 set working directory to desired location.
496 New zebraidx command: clean - removes temporary shadow files.
498 Fixed bug in ISAM system. Occurred rarely during register updates.
500 Logging during index merge phase is improved. The remaining running
503 Temporary files generated by zebraidx are removed after each run.
505 Bug fix: Dictionary didn't handle 8-bit characters correctly; was obvious
506 when doing scan operations in dictionaries with European characters.
510 A whole slew of updates, to make the first publicized release. Get the doc
515 Memory-problems in ISAM fixed. More blocktypes added to the default setup
516 to increase performance on larger databases.
518 Various minor changes in data management system.
522 A couple of portability-problems resolved.
524 Changed some malloc() to xmalloc().