3 Update OAI example README and allow Bib-1 attribute searches.
5 Fix ICU indexing test. The code was not really broken, but the test
10 Deb/RPM/Win Zebra packages uses libyaz5 (rather than libyaz4). This adds
11 SRU 2.0 support for Zebra.
15 Updates for YAZ 5. Zebra compiles fine with YAZ 4 still.
19 Addx + document zebraidx command "check", which checks consistency of
22 Debian : idzebra-2.0-utils includes init.d script. Includes logrotate as
23 well. The zebrasrv init script listens on port 2100. At this time,
24 zebra.cfg, is not part of the package. Administrator must install or
25 modify $CONFIG to point to a working zebra.cfg.
27 RPM: idzebra-2.0 includes init.d script. Also includes logrotate. The
28 zebrasrv init script listens on port 2100 (IPv4 + IPv6). At this time,
29 zebra.cfg, is not part of the package. Administrator must install or
30 modify $CONFIG to point to a working zebra.cfg.
34 For mod_dom filter, allow type="adelete", which will not treat a failed
35 delete as an error (such as a record ID that do not exist already).
37 Log XML2/XSLT errors to yaz_log instead of stdout/stderr.
39 Relay \-character in non-regexp searches. Was treated as backslash
44 Improve hit estimate for or-searches (typically truncation)
46 Fix snippets for non-ICU / seqno not updated.
48 Replace key_compare_it with key_compare. This is because key_compare_it
49 throws exception on some CPUs with alignment constraints.
51 ICU: support @attr 5=2, @attr 5=3 in searches. (left truncation and
52 left+right truncation).
56 Fix problem in dictionary due to increase max size of term.
60 Fix buffer overrun for terms using ICU normalization.
62 Increase max size of indexing term from 256 to 512.
66 Fix a bug in zebra_begin_trans where Zebra could mark a transaction
67 complete when it actually failed. This could happen if register files
72 Scan: allow preferred position > number + 1
74 Fix bug #4592: dict_scan misses
76 Fix snippets for complete fields, bug #4590. The
77 snippet_add_complete_fields (chr-system) now takes the indexing term
78 verbatim and makes that the display term.
82 Utility idebra-abs2dom part of distribution and deb+RPM packages.
84 Fix problem with scan and complete subfields (:p) . In some cases,
85 the display scan terms, would be invalid.
89 RPM: Store libraries in /usr/lib64 on 64-bit platforms.
91 Zebra honors SRU sortkeys. If used with YAZ 4.2.0 or later,
92 CQL sortby is honored as well.
94 Fix scan's handling of normalized terms. Some terms were incorrectly
95 ignored in the scan results, CJK terms in particular.
99 Fix bug in dictionary component of Zebra that could lead to
100 inconsistent register assert for large deleteions.
102 Improve estimate hits for phrase searches.
104 --- 2.0.45 2010/12/22
106 Add Debian package for Ubuntu maverick.
108 Update to newer Libxml2/Libxslt for Windows package.
110 Escape-sequences are disabled for RPN-queries with truncation=105/106.
111 These, unlike regular expressions, do not support \-sequences .
113 --- 2.0.44 2010/06/29
115 grs1: avoid term_len < 0 for .abs operator 'range'
117 ICU: fix use of un-init variable.
119 More reasonable approx hits for truncated searches.
121 Updates WRT Odr_int (YAZ 4).
123 --- 2.0.43 2009/11/05
125 Fix hits counts for searches when @attr 12=n is in use. This bug
126 was introduced in 2.0.40.
128 --- 2.0.42 2009/10/08
130 Proximity modifications. The optimized proximity now deals with more
131 cases, ie all prox of the form @prox 0 d 1 1,2,3 k 2 ..
132 That's exlusive==0, any distance, ordered (true), relation (<, =, <=),
135 Fix bug WRT inconsistent registers, bug #3062.
137 Fix install doc rule so it's compatible with Automake 1.11.
139 --- 2.0.41 2009/08/24
141 Fix typos and other errors in the documentation. Thanks to Galen
144 Fix DOM filter so that full record ID (z:id) if given is used verbatim
145 rather than truncated until first blank - in other words use memcpy
146 rather than sscanf. For PI fix record attributes parsing which was
149 --- 2.0.40 2009/07/13
151 Fixed problem in result set handling and segment handling.
153 --- 2.0.39 2009/07/09
155 Improved speed of record fetching by using a different block sizes
158 Added zlib-compression of recd-storage (record data). This is enabled
159 by using recordCompression: zlib in zebra.cfg.
161 Dictionary delete more agressive (dict_del_string).
163 --- 2.0.38 2009/06/19
165 Improved estimated hits for AND operation (bug #2907)
167 Fixed problem with register area growing after "drop DB". (bug #2913).
169 --- 2.0.37 2009/05/18
171 Example with marc21 is now installed and part of packages.
173 Fixed XSL for OAI example.
175 Fixed problem with generic proximity handling.
177 Added new ranking handler: rank-2. This is a combination of rank-1 and
178 static rank.. The staticrank is inverse (lowest value comes first, etc..).
179 rank-2 thus substracts that from score. This allows a system to specify
180 a "base" rank (=staticrank).
182 --- 2.0.36 2009/02/17
184 Added implementation-codes directive for .mar files.
186 Avoid error for missing recordId when zebraidx' option -s is in use.
188 Fixed problem with some disk blocks not beeing freed correctly when
189 'drop database' is used.
191 --- 2.0.34 2008/11/06
193 Facets can now be performed on sort registers (:s), not just regular indexes
194 (:w, :p) etc.. The performance appers to be much better than before.
196 Added a facility to embed metadata for records generated by the DOM XML
197 filter. The meta data step is triggered by a 'process-meta' section in the
198 retrieve section of the dom config, e.g.
199 <retrieve name="myelementset">
200 <xslt stylesheet="my-usual.xsl"/>
203 The meta section substitutes metadata for all elements called 'meta' in
204 namespace http://indexdata.com/zebra-2.0 . The meta element must have
205 exactly one attribute, name, which specifies the special
206 element set name which is equivalent to the suffix to zebra:: for
207 non-embedded special retrievals. This allows snippets, facets etc to be
210 Fixed bug #2202: incorrect sorting order when searching multiple databases.
212 --- 2.0.32 2008/06/06
216 --- 2.0.30 2008/05/14
218 Changed service name for Windows. Bug #978.
220 Fixed the alwaysmatches including _ALLRECORDS for ICU term indexing. Bug #2139.
222 --- 2.0.28 2008/04/03
224 Handle right-truncation for ICU normalized terms.
226 Updated OAI-PMH example.
228 --- 2.0.26 2008/01/28
230 Fixes for searches on Chinese text.
232 Fixes for scan using ICU indexing terms.
234 --- 2.0.24 2008/01/18
236 Fixed some memory violations for ICU enabled indexing that could be
237 triggered by long phrases.
239 Enable ICU on Windows. Thanks to Tumer Garip for makefile patches.
241 Fixed bug #2002: Zebra crashes during merge using ICU indexing.
243 --- 2.0.22 2007/12/20
245 Handle encoding errors for strings passed to ICU. (assert was
248 Added zebraidx command, adelete, which attempts to delete records.
249 It's like 'delete', but does not fail if a record does not exist.
251 --- 2.0.20 2007/12/19
253 Added experimental support for faceted results. This is implemented
254 as a special retrieval on a result set and is triggered using element
255 set name zebra::facet::f1:t1,f2,t2,.. which will return terms and
256 hit counts for field f1, type t1, field f2, type t2, .. The returned
257 data is packed as XML or SUTRS depending on record syntax.
259 Added support for Unicode-based indexing using ICU. This allows
260 locale specific scanning, sorting. The implementation is based on
261 the ICU utility part of YAZ 3.0.16 and later. See the manual as well
262 as the examples/marcxml for an example of the use of ICU.
264 --- 2.0.18 2007/09/19
266 Fixed bug with scan and staticrank enabled. Bug introduced in 2.0.16.
268 --- 2.0.16 2007/09/12
270 Scan now returns a displayTerm which closer to the original word/phrase
271 from original record.
273 Added snippet support. Element set name zebra::snippet will make
274 Zebra return an XML record with snippets (terms around matching terms).
276 Fixed bug #1142: Non-indexed but listed attributes issues diagnostic.
278 Fixed bug #1131: Missing value-of data in DOM filter.
280 Fixed bug #1049: zebra.cfg lines with leading space are ignored.
282 Fixed bug #1128: sortmax not honored.
284 Fixed bug #1121: Crash for some searches with customized string.chr.
286 --- 2.0.14 2007/05/09
288 Zebra uses the YAZ 3 API. Note that this changes the Zebra API
289 as well. The register layout is the same however.
291 Fixed bug #1114: scan within set may use excessive CPU.
293 Fixed memory leak that occurred in scan.
295 Fixed memory leak that occurred for each deleted record.
297 Optimize updates of records where content is almost identical to previous
298 version of record. This makes updating of the internal explain database
301 For RPN queries the index type (w,p,..) may be specified verbatim as
302 structure attribute with string value, e.g. @attr 4=w .
304 Changed record update API . It is now handled by function
305 zebra_record_update which does insert/replace/delete/update of records .
306 This function replaces zebra_record_{insert,delete} and
307 zebra_admin_exchange_record. The DOM filter uses this feature and the
308 @type attribute in record element specifies the action
309 insert/replace/delete/update.
311 Added support for multi-record updates (Bug #944). Based on patch from
314 --- 2.0.12 2007/03/07
316 Fixed bug with indexing of attributes for rec.grs-class of filters.
317 If X-Path was enabled xelm a/@b would be ignored.
319 Fixed bug in register system where 'no more space' messages was produced
320 even though there was plenty of space.
322 Fixed bug #884: Entity declarations in input are lost at retrieval time.
324 Implemented new filter 'dom'. See test/xslt/dom-config*xml for examples.
325 This, like alvis, performs indexing and retrieval using XSLT. But Unlike
326 alvis, it allows multiple XSLT steps to be performed and does ISO2709
329 --- 2.0.10 2007/01/24
331 Staticrank indexing is now an index register type defined in default.idx
332 via directive 'staticrank'. The 'staticrank' directive for grs is no longer
333 supported (was only implemented for Zebra 2.0.8).
335 For searches, allow truncmax value to be controlled with attribute 13.
336 If given, that overrides the value of 'truncmax'.
338 For truncations being limited (abort at truncmax terms), zebrasrv returns
339 SearchResponse with resultSetStatus=subset.
341 For estimated hit counts, zebrasrv returns SearchResponse with
342 resultSetStatus=estimate.
346 For searches, do not truncate more than at most 'truncmax' terms in one
347 single term with right-truncation/regular attribute. By default, 'truncmax',
350 Bug #781: Easier tracking of result sets. We only do this when mkstemp
351 is available (most moderun Unixes supports this). The PID is included
352 in filename : tempdir/zrs_PID_XXXXXX.
354 Added support for specification of staticrank for grs-class of filters.
355 This is enabled by using 'staticrank indexname' in .abs. Contents of
356 indexname (elm ... indexname:w) is then used as value for staticrank.
358 Implemented sorting via the ISAMB system. To enable, use sortindex:i in
361 Added special retrieval support for sort keys. These keys can also be
362 fetched using zebra::index:field:s
364 Added support for specification of approximative limits for whole query.
365 This is specified as attribute type 12. Semantics is the same as
366 estimatehits in zebra.cfg.
370 Fixed bug #736: Updates gets slower.
372 Fixed bug #735: Delete fails to process rest of file after a record that
375 Added RPM package for Zebra 2.
377 Improved indexing speed for large documents.
379 Added support for special utility retrieval zebra:: which offers retrieval
380 of fundamental properties for record, such as indexed terms, raw record,
381 and system record ID.
385 Fixed bug #47: Commit needs to check for roll-back.
387 Fixed bug #672: Trailing characters in password are ignored
389 Added extra presence check for tcl.h, because some systems have
390 tclConfig.sh installed even though Tcl C headers are missing.
392 Optimized melm performance.
394 Do not use sync(2) during commit (but rely on sync'd individual files).
396 Fixed bug in ISAMB's utility function decode_ptr. With gcc -O3 on some
397 platforms the src argument was not updated. Problem was compiler
398 optimization due to strict aliasing rules.
402 Bug fixes: #638, #647, #657, #669.
404 Implement skip of 0 hit counts in scan. Useful for scan operations
405 limited by a result set.
407 Honor position attribute, i.e. allow first-in-field search. To
408 enable this, "firstinfield 1" must be given for an index in
409 default.idx. Enabled in tab/default.idx for w. At this stage
410 first-in field is supported for phrase/and-list/or-list searches
412 Common stream reader interface for record filters (struct ZebraRecStream).
414 Debian package fix: packages idzebra-2.0 + libidzebra-2.0-modules did
415 not depend properly on sub packages.
419 New record filter (record type) 'alvis' which uses XSLT transformations
420 to drive both indexing as well as retrieval. See example configuration in the
421 'example/alvis-oai' directory.
423 'isamb' is now the default ISAM system. In Zebra 1.3, the default ISAM was
424 'isamc'. The type used can still be configured with the 'isam' setting
427 Index structure is now 64-bit based, also on 32 bit systems.
428 There are no more 2GB register file limits.
430 Extended search result tuning. Approximate limit for terms can be enabled
431 and specified with attribute 11. The (approx or exact) hit count is returned
432 as part of the search response as in 1.3 series. The subqueryID of a search
433 term hit count can be specified with attribute 10.
435 Zebra uses string attributes for indexing internally. Using set+numeric
436 use attribute can still be used. This is a search-only conversion which
437 inspects '*.att'-set files as indicated using attset-directives in 'zebra.cfg'.
438 'attset' references are no longer required, but when used they deserve
439 as "check" for that the index names used are also present in '*.att'.
441 Zebra record filters (record type handlers) may be built as loadable
442 modules (.so's) on Unix. In particular the Zebra 2.0 Debian package uses
443 separate packages for each of them. This also means that zebra programs
444 such as zebraidx is no longer depending on Tcl/other..
446 Documentation updates, especially on query structure and syntax, SRU,
447 XSLT support, alvis filter module, and many added examples.
449 Improved logging of the 'zebrasrv' and 'zebraidx' binaries.
451 Improved debian package structure.
453 --- 1.3.16 2004/08/16