pazpar2-moved-to-github.git
14 years agoAdded performance test setup.
Dennis Schafroth [Mon, 17 May 2010 11:45:46 +0000 (13:45 +0200)]
Added performance test setup.

Added a pazpar2.cfg (for performance testing), and
services for performace using marc21, turbomarc, opac with embedded turbomarc,
and one smaller service configuration also using turbomarc.

14 years agoAdded XML style sheet transformation for using OPAC with embedded turbomarc.
Dennis Schafroth [Mon, 17 May 2010 11:44:02 +0000 (13:44 +0200)]
Added XML style sheet transformation for using OPAC with embedded turbomarc.

14 years agoFix the log statement on sel file descriptor (sel_fd)
Dennis Schafroth [Mon, 17 May 2010 11:26:59 +0000 (13:26 +0200)]
Fix the log statement on sel file descriptor (sel_fd)

14 years agoNew config for par.sh
Dennis Schafroth [Wed, 5 May 2010 12:57:58 +0000 (14:57 +0200)]
New config for par.sh

14 years agoCarrot2 experimenting stylesheet updated for use with cf targets.
Jason Skomorowski [Fri, 7 May 2010 13:45:29 +0000 (09:45 -0400)]
Carrot2 experimenting stylesheet updated for use with cf targets.

14 years agoXSLT to convert Pazpar2's output for reading by Carrot2 clustering engine.
Jason Skomorowski [Thu, 6 May 2010 18:58:54 +0000 (14:58 -0400)]
XSLT to convert Pazpar2's output for reading by Carrot2 clustering engine.

14 years agoUpdate NEWS WRT pz:max_connections
Adam Dickmeiss [Thu, 6 May 2010 15:51:59 +0000 (17:51 +0200)]
Update NEWS WRT pz:max_connections

14 years agoFix the fix on unlimited connections.
Dennis Schafroth [Thu, 6 May 2010 11:05:36 +0000 (13:05 +0200)]
Fix the fix on unlimited connections.

Nice, Dennis. End-less loop.
Break out, if max_connections is not active or if we havent used more connections than max connections.

14 years agoFix max_connection when ulimited.
Dennis Schafroth [Thu, 6 May 2010 09:25:51 +0000 (11:25 +0200)]
Fix max_connection when ulimited.

The actual block should also disabled when running ulimited.

14 years agoMax (target) connections is ulimited as default
Dennis Schafroth [Thu, 6 May 2010 09:16:41 +0000 (11:16 +0200)]
Max (target) connections is ulimited as default

To maintain backwards compatibility the max connection is by default ulimited.
Only by specifying a configuration larger than 0, will it be enforced.

14 years agoAdds availability info from circulations
Niels Erik G. Nielsen [Wed, 5 May 2010 13:01:51 +0000 (15:01 +0200)]
Adds availability info from circulations

14 years agoFun normalize_record_transform: fix un-init var
Adam Dickmeiss [Wed, 5 May 2010 11:30:45 +0000 (13:30 +0200)]
Fun normalize_record_transform: fix un-init var

And reformat a bit.

14 years agoGenerate init,search,show stats from timed log
Dennis Schafroth [Tue, 4 May 2010 20:20:43 +0000 (22:20 +0200)]
Generate init,search,show stats from timed log

14 years agoNew script from dennis_threading branch
Dennis Schafroth [Tue, 4 May 2010 20:17:26 +0000 (22:17 +0200)]
New script from dennis_threading branch

14 years agoXSL from dennis_threading branch: extract active client count
Dennis Schafroth [Tue, 4 May 2010 20:15:20 +0000 (22:15 +0200)]
XSL from dennis_threading branch: extract active client count

14 years agoserver shutdown script
Dennis Schafroth [Tue, 4 May 2010 20:14:38 +0000 (22:14 +0200)]
server shutdown script

14 years agoVersion from dennis_threading
Dennis Schafroth [Tue, 4 May 2010 20:14:03 +0000 (22:14 +0200)]
Version from dennis_threading

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Dennis Schafroth [Tue, 4 May 2010 15:40:10 +0000 (17:40 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agohmm, added twice.
Dennis Schafroth [Tue, 4 May 2010 15:40:02 +0000 (17:40 +0200)]
hmm, added twice.

14 years agoFix: destroy the iochan manager mutex
Dennis Schafroth [Tue, 4 May 2010 14:21:29 +0000 (16:21 +0200)]
Fix: destroy the iochan manager mutex

14 years agoSERVICE and SHUTDOWN is now configurable
Dennis Schafroth [Tue, 4 May 2010 14:20:12 +0000 (16:20 +0200)]
SERVICE and SHUTDOWN is now configurable

14 years agoAdd service as 3rd parameter
Dennis Schafroth [Tue, 4 May 2010 14:18:59 +0000 (16:18 +0200)]
Add service as 3rd parameter

14 years agoManuel merge from dennis_threading branch
Dennis Schafroth [Mon, 3 May 2010 09:24:40 +0000 (11:24 +0200)]
Manuel merge from dennis_threading branch

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Dennis Schafroth [Mon, 3 May 2010 08:31:56 +0000 (10:31 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agocherry-pick generate_plot.sh from dennis_threading branch
Dennis Schafroth [Thu, 29 Apr 2010 12:09:38 +0000 (14:09 +0200)]
cherry-pick generate_plot.sh from dennis_threading branch

Generate gnutplot files instead of assuming the present

Conflicts:

14 years agoDebian: depend on libgnutls-dev (libyaz4-dev dont) v1.4.0
Adam Dickmeiss [Thu, 29 Apr 2010 11:26:50 +0000 (13:26 +0200)]
Debian: depend on libgnutls-dev (libyaz4-dev dont)

14 years agoDebian 1.4.0-1
Adam Dickmeiss [Thu, 29 Apr 2010 11:08:00 +0000 (13:08 +0200)]
Debian 1.4.0-1

14 years agoVersion 1.4.0
Adam Dickmeiss [Thu, 29 Apr 2010 11:06:14 +0000 (13:06 +0200)]
Version 1.4.0

14 years agoMerge branch 'channel_list_mutex'
Adam Dickmeiss [Thu, 29 Apr 2010 10:57:21 +0000 (12:57 +0200)]
Merge branch 'channel_list_mutex'

14 years agoRemoved tmarcxml.xsl. Replace by tmarc.xsl
Dennis Schafroth [Thu, 29 Apr 2010 10:44:16 +0000 (12:44 +0200)]
Removed tmarcxml.xsl. Replace by tmarc.xsl

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Dennis Schafroth [Thu, 29 Apr 2010 10:42:02 +0000 (12:42 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoSimplify the channel_list mutex locking. Fixed C90 warning.
Dennis Schafroth [Thu, 29 Apr 2010 09:24:44 +0000 (11:24 +0200)]
Simplify the channel_list mutex locking. Fixed C90 warning.

Drop the iochan_man iter. We take a snapshot (start) of the channel_list
in the beginng of the loop, but otherwise it does not need to be protected.

14 years agoDeb rules: copy .png rather than gif
Adam Dickmeiss [Thu, 29 Apr 2010 09:12:16 +0000 (11:12 +0200)]
Deb rules: copy .png rather than gif

14 years agoMerge branch 'master' into channel_list_mutex
Dennis Schafroth [Thu, 29 Apr 2010 08:51:14 +0000 (10:51 +0200)]
Merge branch 'master' into channel_list_mutex

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Dennis Schafroth [Thu, 29 Apr 2010 08:47:35 +0000 (10:47 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoMerge branch 'master' into channel_list_mutex
Dennis Schafroth [Thu, 29 Apr 2010 08:42:32 +0000 (10:42 +0200)]
Merge branch 'master' into channel_list_mutex

14 years agoAdd edu_turbo configuration.
Dennis Schafroth [Thu, 29 Apr 2010 07:38:16 +0000 (09:38 +0200)]
Add edu_turbo configuration.

Same as default but using turbomarc between yaz library and pazpar2.

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Niels Erik G. Nielsen [Wed, 28 Apr 2010 22:08:10 +0000 (15:08 -0700)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoAdds 'available' to holdings information
Niels Erik G. Nielsen [Wed, 28 Apr 2010 22:06:40 +0000 (15:06 -0700)]
Adds 'available' to holdings information

14 years agoFixed: missing release_session. Using HTTP module log level some places.
Dennis Schafroth [Wed, 28 Apr 2010 16:14:06 +0000 (18:14 +0200)]
Fixed: missing release_session. Using HTTP module log level some places.

14 years agoMerge branch 'master' of ssh://git/home/git/pub/pazpar2
Sebastian Hammer [Wed, 28 Apr 2010 14:09:03 +0000 (14:09 +0000)]
Merge branch 'master' of ssh://git/home/git/pub/pazpar2

14 years agoFixed capitalization of Pazpar2.
Sebastian Hammer [Wed, 28 Apr 2010 14:08:31 +0000 (14:08 +0000)]
Fixed capitalization of Pazpar2.

14 years agoMerge branch 'channel_list_mutex' of ssh://git.indexdata.com/home/git/pub/pazpar2...
Dennis Schafroth [Wed, 28 Apr 2010 14:07:38 +0000 (16:07 +0200)]
Merge branch 'channel_list_mutex' of ssh://git.indexdata.com/home/git/pub/pazpar2 into channel_list_mutex

14 years agoRemoved unlocking/lock of clients as in master.
Dennis Schafroth [Wed, 28 Apr 2010 14:07:30 +0000 (16:07 +0200)]
Removed unlocking/lock of clients as in master.

14 years agoFixed warnings: wrong return parameter. C90 compliant.
Dennis Schafroth [Wed, 28 Apr 2010 14:06:35 +0000 (16:06 +0200)]
Fixed warnings: wrong return parameter. C90 compliant.

14 years agoFixed: mutex protect session nmem malloc in show_range_start. Cosmetic: renamed sessi...
Dennis Schafroth [Wed, 28 Apr 2010 14:03:33 +0000 (16:03 +0200)]
Fixed: mutex protect session nmem malloc in show_range_start. Cosmetic: renamed session *s to session *se.

14 years agoBuild require YAZ 4.0.4
Adam Dickmeiss [Wed, 28 Apr 2010 13:03:40 +0000 (15:03 +0200)]
Build require YAZ 4.0.4

14 years agoRequire YAZ 4.0.4. No need for libyaz_server.
Adam Dickmeiss [Wed, 28 Apr 2010 12:59:34 +0000 (14:59 +0200)]
Require YAZ 4.0.4. No need for libyaz_server.

14 years agoUpdate for changed 3arg for yaz_cond_wait
Adam Dickmeiss [Wed, 28 Apr 2010 12:58:58 +0000 (14:58 +0200)]
Update for changed 3arg for yaz_cond_wait

14 years agoLowered number to 10 clients
Dennis Schafroth [Wed, 28 Apr 2010 12:25:23 +0000 (14:25 +0200)]
Lowered number to 10 clients

14 years agoAdded .time files and run* directories to ignore.
Dennis Schafroth [Wed, 28 Apr 2010 12:24:41 +0000 (14:24 +0200)]
Added .time files and run* directories to ignore.

14 years agoImplemented the destroy_counter on HTTP commands. Only destroy HTTP session if no...
Dennis Schafroth [Wed, 28 Apr 2010 12:07:40 +0000 (14:07 +0200)]
Implemented the destroy_counter on HTTP commands. Only destroy HTTP session if no http command is active.

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Wed, 28 Apr 2010 08:34:21 +0000 (10:34 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoingest_record: lock client, then session
Adam Dickmeiss [Wed, 28 Apr 2010 08:32:49 +0000 (10:32 +0200)]
ingest_record: lock client, then session

lock client, then session rather than the reverse way. This
saves us locking but more importantly prevents that session
gets destroyed under our feet (while client and session is
not locked).

14 years agoset charset to utf-8
Wolfram Schneider [Tue, 27 Apr 2010 15:21:08 +0000 (15:21 +0000)]
set charset to utf-8

14 years agoFixed colors
Sebastian Hammer [Tue, 27 Apr 2010 15:06:16 +0000 (11:06 -0400)]
Fixed colors

14 years agoIndented.
Dennis Schafroth [Tue, 27 Apr 2010 14:19:11 +0000 (16:19 +0200)]
Indented.

Fixed: Keeping the start of the channel list as invariant through the event loop, so we dont look at newly added IOCHANnels. This could be the cause of the messed-up http show call.

Started on the refactoring of moving to yaz_poll, but holding back to see if this fix works.

14 years agoNew setting setting: pz:max_connections
Adam Dickmeiss [Tue, 27 Apr 2010 12:50:44 +0000 (14:50 +0200)]
New setting setting: pz:max_connections

Setting pz:max_connections is a limit of number of sockets to a host.
When this limit is reached, Pazpar2 will wait up to 5 seconds for a
connection to becomes available. The client will be marked Client_Error
when it can not be searched (other clients in a session may work).
If pz:max_connections is not set for a target, a value of 30 will be
used.

14 years agoAdded PP2 session create/destroy logging
Dennis Schafroth [Tue, 27 Apr 2010 11:49:03 +0000 (13:49 +0200)]
Added PP2 session create/destroy logging

14 years agoAdded work queue length logging
Dennis Schafroth [Tue, 27 Apr 2010 11:47:59 +0000 (13:47 +0200)]
Added work queue length logging

14 years agoAdded more HTTP session logging
Dennis Schafroth [Tue, 27 Apr 2010 11:47:10 +0000 (13:47 +0200)]
Added more HTTP session logging

14 years agoMerge branch 'master' into channel_list_mutex
Dennis Schafroth [Tue, 27 Apr 2010 09:01:49 +0000 (11:01 +0200)]
Merge branch 'master' into channel_list_mutex

14 years agoUse tmarc.xsl
Dennis Schafroth [Tue, 27 Apr 2010 09:00:09 +0000 (11:00 +0200)]
Use tmarc.xsl

14 years agoAdded iochan_man iterator: Protects the initial node in threaded code.
Dennis Schafroth [Tue, 27 Apr 2010 08:58:54 +0000 (10:58 +0200)]
Added iochan_man iterator: Protects the initial node in threaded code.

14 years agoRemove maskfun/socketfun
Adam Dickmeiss [Tue, 27 Apr 2010 08:46:22 +0000 (10:46 +0200)]
Remove maskfun/socketfun

14 years agoAdd facility to track total connections in use
Adam Dickmeiss [Mon, 26 Apr 2010 11:11:30 +0000 (13:11 +0200)]
Add facility to track total connections in use

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Mon, 26 Apr 2010 10:23:36 +0000 (12:23 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoupdate ID logo
Wolfram Schneider [Mon, 26 Apr 2010 09:33:58 +0000 (09:33 +0000)]
update ID logo

14 years agoIndex Data green, Bug 3403
Wolfram Schneider [Mon, 26 Apr 2010 09:31:26 +0000 (09:31 +0000)]
Index Data green, Bug 3403

14 years agoUpdate test for raw show to usmarc rather than xml
Adam Dickmeiss [Mon, 26 Apr 2010 09:08:32 +0000 (11:08 +0200)]
Update test for raw show to usmarc rather than xml

14 years agoremove stale $Id$ tag
Wolfram Schneider [Sat, 24 Apr 2010 10:12:04 +0000 (12:12 +0200)]
remove stale $Id$ tag

14 years agoupgrade copyright to 2010, bug #3404
Wolfram Schneider [Sat, 24 Apr 2010 10:10:10 +0000 (12:10 +0200)]
upgrade copyright to 2010, bug #3404

14 years agoFixed speling of Index Data
Sebastian Hammer [Sat, 24 Apr 2010 04:11:19 +0000 (04:11 +0000)]
Fixed speling of Index Data

14 years agoRead co->client only when co is locked
Adam Dickmeiss [Fri, 23 Apr 2010 13:33:31 +0000 (15:33 +0200)]
Read co->client only when co is locked

14 years agoAvoid client_set_state on destroyed client
Adam Dickmeiss [Fri, 23 Apr 2010 11:54:21 +0000 (13:54 +0200)]
Avoid client_set_state on destroyed client

Call client_set_state before connection_destroy because
connection_destroy might remove client (reference count 0).

14 years agoconf_get_fname takes conf_config as arg
Adam Dickmeiss [Fri, 23 Apr 2010 11:34:42 +0000 (13:34 +0200)]
conf_get_fname takes conf_config as arg

conf_get_fname takes conf_config rather than conf_service as argument.
This function is used by the normalize_record system.

14 years agoCall relevance_destroy before nmem_reset
Adam Dickmeiss [Fri, 23 Apr 2010 11:33:58 +0000 (13:33 +0200)]
Call relevance_destroy before nmem_reset

This to a void that relevance_destroy refers to NMEM released
memory.

14 years agoDeclare conf_service
Adam Dickmeiss [Fri, 23 Apr 2010 11:21:42 +0000 (13:21 +0200)]
Declare conf_service

14 years agoRemove pazpar2_sleep (for client lock test)
Adam Dickmeiss [Thu, 22 Apr 2010 11:45:53 +0000 (13:45 +0200)]
Remove pazpar2_sleep (for client lock test)

14 years agoRename connection local to co (from new)
Adam Dickmeiss [Thu, 22 Apr 2010 08:54:44 +0000 (10:54 +0200)]
Rename connection local to co (from new)

14 years agoRemove two unused struct decls
Adam Dickmeiss [Thu, 22 Apr 2010 08:52:00 +0000 (10:52 +0200)]
Remove two unused struct decls

14 years agoinclude of yaz/proto.h not necessary
Adam Dickmeiss [Thu, 22 Apr 2010 08:49:03 +0000 (10:49 +0200)]
include of yaz/proto.h not necessary

14 years agoconnection_release private
Adam Dickmeiss [Thu, 22 Apr 2010 08:47:50 +0000 (10:47 +0200)]
connection_release private

14 years agoRemove unused function connection_get_url
Adam Dickmeiss [Thu, 22 Apr 2010 08:46:44 +0000 (10:46 +0200)]
Remove unused function connection_get_url

14 years agohttp_session_destroy: dont wait for active clients
Adam Dickmeiss [Thu, 22 Apr 2010 08:44:09 +0000 (10:44 +0200)]
http_session_destroy: dont wait for active clients

Because we have introduced client locking, each client owned by
a session will be notified that the session is gone.

14 years agoIntroduce client_locking
Adam Dickmeiss [Thu, 22 Apr 2010 08:42:53 +0000 (10:42 +0200)]
Introduce client_locking

14 years agoRename session mutex to session_mutex
Adam Dickmeiss [Wed, 21 Apr 2010 13:17:33 +0000 (15:17 +0200)]
Rename session mutex to session_mutex

14 years agoClient list for session to separate client_list
Adam Dickmeiss [Tue, 20 Apr 2010 12:24:28 +0000 (14:24 +0200)]
Client list for session to separate client_list

14 years agoNo lock on host->mutex for non-timeout events
Adam Dickmeiss [Tue, 20 Apr 2010 11:10:58 +0000 (13:10 +0200)]
No lock on host->mutex for non-timeout events

In connection_handler.

14 years agoRemove client_fatal. connection_destroy is static
Adam Dickmeiss [Tue, 20 Apr 2010 11:10:22 +0000 (13:10 +0200)]
Remove client_fatal. connection_destroy is static

14 years agoLock connection host->mutex in connection_handler
Adam Dickmeiss [Tue, 20 Apr 2010 10:52:36 +0000 (12:52 +0200)]
Lock connection host->mutex in connection_handler

If a timeout occurs when a client exists and is non-Idle, the timeout
is ignored. This ensures that if a timeout happens after a connection
is picked up in client_prep_connection, then it is not destroyed
(soon after).

In connection_create, move code that adds connection to host list to
the end of the creation phase.

14 years agoCall client_destroy when releasing it from session
Adam Dickmeiss [Mon, 19 Apr 2010 11:52:03 +0000 (13:52 +0200)]
Call client_destroy when releasing it from session

14 years agoclient counting (for debugging)
Adam Dickmeiss [Mon, 19 Apr 2010 11:42:25 +0000 (13:42 +0200)]
client counting (for debugging)

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Mon, 19 Apr 2010 10:59:31 +0000 (12:59 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoLog incref/destroy, remove redundant client_incref
Adam Dickmeiss [Mon, 19 Apr 2010 10:58:33 +0000 (12:58 +0200)]
Log incref/destroy, remove redundant client_incref

14 years agoRemove redundant client_incref, client_destroy
Adam Dickmeiss [Mon, 19 Apr 2010 10:56:52 +0000 (12:56 +0200)]
Remove redundant client_incref, client_destroy

14 years agoMangle ZOOM_resultset in client_set_connection
Adam Dickmeiss [Thu, 15 Apr 2010 13:06:14 +0000 (15:06 +0200)]
Mangle ZOOM_resultset in client_set_connection

The ZOOM resultset is now reset in client_set_connection rather than
being destroyed in client_destroy.

14 years agoSimplify session_remove_clients
Adam Dickmeiss [Thu, 15 Apr 2010 13:00:47 +0000 (15:00 +0200)]
Simplify session_remove_clients

14 years agoAdd pazpar2_sleep utility
Adam Dickmeiss [Tue, 13 Apr 2010 13:32:36 +0000 (15:32 +0200)]
Add pazpar2_sleep utility

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Mon, 12 Apr 2010 10:20:29 +0000 (12:20 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2