Time  Nick    Message
09:31 paul    chris around ?
03:14 fbcit-1 you can file a feature request... ;-)
03:08 kados   fbcit-1 takes over the whole installer for Koha :-)
02:53 fbcit-1 it uses xml files to configure and produces msi files.
02:52 fbcit-1 I worked with it for awhile trying to work up a win32 installer for another project.
02:51 fbcit-1 now... have fun... :-P
02:51 fbcit-1 http://wix.sourceforge.net/
02:51 fbcit-1 M$
02:51 fbcit-1 released on sourceforge by....
02:50 fbcit-1 wix...
02:50 fbcit-1 there is... hold on...
02:49 kados   i wonder if there is such a thing as a open source windows packaging system
02:49 kados   unfortunately he uses a proprietary packaging system
02:49 kados   yea, there's someone who maintains that separately from mainline koha's installer
02:48 fbcit-1 looks like your windows port has some sort of installer?
02:46 fbcit-1 I wonder if you could install it on a wap using white russian?
02:43 kados   that rocked :-)
02:43 kados   hehe, or a digital watch :-)
02:41 chris   its a short step from there to a coffee mug :)
02:40 chris   someone had koha running on their playstation
02:40 chris   heh
02:40 fbcit-1 maybe we could embed koha in a mug that would index various international coffees... ;-)
02:39 chris   i cant even get to cafepress
02:39 chris   we did those in feb 2003
02:38 chris   ahh
02:38 fbcit-1 http://www.cafepress.com/koha/
02:38 fbcit-1 my screen is blank...
02:37 chris   the katipo ones are old
02:37 fbcit-1 which ones? :-)
02:37 chris   heh, those are pretty old
02:20 kados   k
02:19 fbcit-1 I'll setup an email addr and get it to you.
02:19 fbcit-1 seems dangerous
02:19 kados   that'd be great
02:18 fbcit-1 I don't like mysql's INSERT IGNORE....
02:18 fbcit-1 I had thought about having patches which involve sql cc'd to an email address to me so I would be sure to see those and port them...
02:17 kados   and the versioning scheme ensures that only the updates you haven't got will be applied
02:17 fbcit-1 I thought that
02:17 kados   concurrent with updatedatabase
02:17 kados   it changes all the time
02:16 kados   well ...
02:16 kados   that's the idea
02:16 fbcit-1 so kohastructure changes only on major releases?
02:16 kados   yep, all of them are
02:16 fbcit-1 that would be ideal
02:16 kados   all of them are
02:16 fbcit-1 Are most db updates done both in updatedatabase & kohastructure?
02:16 kados   otherwise it's gonna be a nightmare to keep everything in sync
02:15 kados   it would be ideal if we could have only generic sql in updatedatbase
02:15 kados   k
02:15 fbcit-1 I peeked, but did not have time to really get into it... git was hot on my heals....
02:14 kados   are there mysqlisms in there>?
02:14 kados   I noticed you moved updatedatabase into the mysql dir
02:14 kados   yea, do you have ideas for that?
02:14 kados   yea, I'm sorry, there have been some db changes recently
02:14 fbcit-1 keeping the two db ports in sync with most devs working on the mysql side...
02:14 kados   hehe
02:13 fbcit-1 which brings up another *issue*...
02:13 fbcit-1 I need to finish porting the latest kohastructure.sql to pg prior to importing that data.
02:11 kados   :-)
02:11 fbcit-1 don't have time to harden that port on my firewall... sorry.
02:11 kados   ahh
02:11 fbcit-1 I was getting pounded pretty hard on ssh so I closed up the port...
02:10 kados   ok :-)
02:10 kados   ahh
02:10 kados    perl misc/migration_tools/bulkmarcimport -file
02:10 kados   export KOHA_CONF=/opt/koha/etc/koha-conf.xml
02:10 kados   wget http://kados.org/stuff/outkoha.mrc
02:10 kados   if you have 2 minutes right now you could do it
02:09 fbcit-1 I'll grab them tomorrow after gk class and give it a whirl.
02:09 kados   there's a quick but complicated way if you're impatient
02:09 kados   that's your MARC records if you wanna try
02:09 kados   wget http://kados.org/stuff/outkoha.mrc
02:08 kados   and go get a pizza :-)
02:08 kados   perl misc/cronjobs/zebraqueue_start.pl
02:08 kados   then:
02:08 kados   and -D if you want to start it as a daemon
02:08 kados   zebrasrv -f /path/to/koha-conf.xml
02:08 kados   start zebra:
02:08 kados   (long meaning it takes forever)
02:07 kados   long and easy way is:
02:07 kados   then ... there are two options
02:07 kados   perl misc/migration_tools/bulkmarcimport -file /path/to/marc.mrc
02:06 kados   export KOHA_CONF=/path-to-koha-conf.xml
02:06 kados   you basically just run:
02:06 kados   I have a batch you could try if you're interested
02:06 kados   loading data is pretty simple
02:05 fbcit-1 you might should mention that the pg port is alpha in case I don't get it completed in time...
02:05 kados   sweetness
02:05 fbcit-1 there may not be quite as many mysqlisms as might be feared.
02:04 fbcit-1 I need to load up sample data into pg and pound it
02:04 fbcit-1 tnx
02:04 kados   fbcit-1:  I added you to the credits page :-)
02:03 kados   and a possible shift to a new installer ;-)
02:03 kados   only I think two more features and a few enhancements/bugs holding us back
02:03 kados   now that things are settling down should be easier
02:03 kados   we'll have a chance to write up some detailed docs once we release the 3.0 beta
02:02 kados   well ...
02:02 kados   hehe
02:00 fbcit-1 sys admins have to know something as a prereq :-)
01:59 kados   will do
01:59 fbcit-1 kados: I did not update it because it worked for me.  Sorry. You can...
01:58 kados   fbcit-1: I'm gonna go wild on the README.txt :-)
01:50 kados   fbcit-1: did you update that or should I?
01:50 kados   it should be -f though
01:50 kados   weird
01:50 kados   and yet that works for you
01:49 kados   ahh, he was doing -c
01:48 kados   fbcit-1: did you see that weird message on koha-devel that someone's getting about a missing colon after yazgfs?
01:43 kados   I like the idea of ./kohainstall.pl
01:42 kados   sorry fbcit-1
01:26 fbcit-1 unless I am mistaken, uninstalling is just a matter of deleting three or so subdirs and dropping a db. That could be scripted.
01:21 fbcit-1 kados: I posted the thought to koha-devel
01:09 fbcit-1 kados: we use PREFIX=
01:05 fbcit-1 so running ./kohainstall.pl prompts the admin for possible vars, supplying defaults if not overridden, and then does make && make install all in one shot.
01:03 fbcit-1 One advantage of Module::Build is that since it's implemented as Perl methods, you can invoke these methods directly if you want to install a module non-interactively. For instance, the following Perl script will invoke the entire build/install procedure
01:03 fbcit-1 interesting:
00:58 fbcit-1 we may need to abandon the idea of symlinks in light of the multi-os issues (although I think they are a neat approach).
00:56 kados   make sure that MJ doesn't have a reason he picked MakeMaker over M::B
00:56 kados   I think this should be discussed on koha-devel
00:56 kados   yea
00:55 fbcit-1 if the switch to M::B makes sense, now is the time to do it.
00:55 kados   which do we use?
00:55 kados              the same location as ExtUtils::MakeMaker" in Module::Build::Cookbook for further information."
00:55 kados   "If you do not need to retain compatibility with ExtUtils::MakeMaker or are starting a fresh Perl installation we recommand you use "install_base" instead (and "INSTALL_BASE" in ExtUtils::MakeMaker).  See "Instaling in
00:53 kados   hmmm
00:53 fbcit-1 I think we can have the makefile built based on lang/marcflavour
00:53 kados   "Natively, Module::Build provides default installation locations for the following types of installable items:"
00:51 kados   hehe
00:51 fbcit-1 because koha should never be uninstalled... :-)
00:50 kados   I'm confused why neither of these has an uninstall option
00:50 kados   yea, this sounds like the ticket
00:50 fbcit-1 there is a makemake wrapper for it also
00:49 fbcit-1 the coversion to M::B is supposed to be very straightforward.
00:49 kados   that's what I'm thiking
00:49 kados   yea
00:49 kados   what would be involved in porting?
00:49 kados   hmmm
00:49 kados   right
00:49 fbcit-1 M::B is not platform dependent, but is pure perl
00:49 fbcit-1 another point concerning makemaker: it is platform dependent since it uses make...
00:48 kados   might be easier in the short term
00:48 kados   rather than symlinks?
00:48 kados   cp filename newfilename
00:48 kados   that might be more portable actually
00:48 fbcit-1 there must be a way to tell make to build symlinks rather than simply doing cp'g
00:48 kados   can make rename files?
00:48 kados   that's probably OK
00:48 kados   well
00:47 kados   ahh
00:47 fbcit-1 zebra works, but no symlinks
00:47 fbcit-1 make followed the symlinks and installed the actual file rather than the link
00:47 kados   and it's happy?
00:46 fbcit-1 ran make && make install
00:46 fbcit-1 added the symlinks
00:46 fbcit-1 I did the file/dir changes in my clone
00:46 fbcit-1 I can't find much on symlinks and make
00:45 fbcit-1 Apparently CPAN depends on MakeMaker, but CPANPLUS uses Module::Build...anyhow
00:45 kados   huh
00:45 fbcit-1 According to the maintainer of MakeMaker, Module::Build is to replace it
00:44 kados   I'm not
00:44 fbcit-1 are you familiar with Module::Build?
00:41 kados   fbcit-1: any progress?
00:34 kados   I'll just push it up
00:34 kados   did this one in my rmtest
00:34 kados   oops
00:34 kados   chris: passing off to you
00:34 kados   still are but I added a few
00:32 chris   *grin*
00:30 atz     s/(fla|col|fav)or/$1our/g;
00:30 kados   we were missing a ton of libraries in here
00:29 kados   en-US
00:29 kados   hehe
00:29 chris   i always lose at scrabble, because we have fair less words with z in it that you guys :)
00:28 chris   we need to localise our localization
00:28 kados   chris: you brit you
00:28 kados   hehe
00:28 chris   and spelling it localisation :-)
00:28 atz     :)
00:28 kados   :-)
00:27 atz     like date format
00:27 kados   dateformat
00:27 atz     right
00:27 kados   and moving all the localization things to that tab
00:27 kados   just a matter of adding it to systempreferences.pl
00:27 kados   you can do it
00:22 atz     did you start on that, or can I do it?
00:21 atz     kados: i agree, i think we need a Localization tab
00:18 atz     )
00:18 atz     (that's how many are in /usr/share/zoneinfo
00:17 kados   wow
00:14 atz     we now have 1685 rows in mysql.time_zone_name !
00:09 atz     so we can test this timezones thing (on arwen)
00:08 atz     ok I granted select on mysql.time_zone_name for rch jmf cfc frc and gmc
23:59 fbcit-1 I'm trying to figure out how to have make write symlinks.
23:58 fbcit-1 I saw.
23:55 kados   fbcit-1: pushed up your patches just now
23:55 kados   hiya fbcit-1
23:55 kados   hiya fbcit-away
20:55 atz     he's in a brief meeting, presently
20:51 fbcit   kados?
20:36 fbcit   the wisdom of #git says that git will track symlinks.
20:34 fbcit   at some point we could write a Makefile.PL eq in msi...
20:34 kados   :-)
20:34 fbcit   installer
20:34 fbcit   I have played with windows istaller.... yuk!
20:33 kados   to explain what needs to be done
20:33 kados   and adding a big warning somewhere to the web installer
20:33 kados   yea
20:32 kados   and the windows package maintainer has to make up his own stuff :)
20:32 kados   unless we just decide this installer i just for *nix
20:32 kados   arrg
20:32 kados   I mean ... filesystem
20:32 kados   I woudln't want to tie our design choices to a specific os
20:32 kados   but most koha windows users aren't running ntfs I'm guessing
20:32 kados   yea
20:31 fbcit   which are essentially the same as hard links in Unix.
20:31 fbcit   symbolic links, on an NTFS filesystem.  They also allow hard links,
20:31 fbcit   NTFS 5.0 supports what they call junctions, which are similar to
20:31 fbcit   kados: from google:
20:30 fbcit   ouch
20:30 kados   but we do have a big Koha Windows contingency
20:30 fbcit   I think that NTFS does some sort of symlink....
20:29 kados   M$--
20:29 kados   arrg
20:29 fbcit   I thought of M$ earlier...
20:29 kados   also, that approach won't work on windows
20:29 kados   can we get git to store symlinks?
20:29 kados   sounds good
20:29 fbcit   so why don't we build sym links in which default zebra to en and marc21, then let Makefile.PL write new ones if specified?
20:28 kados   yes
20:28 fbcit   kados: the default lang is en, right?
20:09 kados   no, that's fine
20:08 fbcit   zebradb/biblios/etc/lang/en and biblios/etc/marcflavour/marc21
20:08 fbcit   or is this too much?
20:07 fbcit   I am thinking of an altered dir structure... ie zebradb/etc/lang/en... to hold language specific files
20:06 kados   because, for instance, there are english users of unimarc
20:06 kados   separate
20:05 fbcit   or keep it separate?
20:05 fbcit   kados: shall we wrap the marc issue up inside the language issue?
20:04 fbcit   zebra says the same as before
20:04 fbcit   lrwxrwxrwx 1 root root   22 2007-11-13 14:54 sort-string-utf.chr -> sort-string-utf-us.chr
20:02 fbcit   k
20:02 kados   and create symlinks for the .chr files
20:02 kados   but lets keep default.idx as is
20:01 kados   sweet
20:01 fbcit   14:52:14-13/11 [server] Starting server zebrasrv pid=19409
20:01 fbcit   14:52:14-13/11 [server] Adding dynamic listener on tcp:@:9999 id=0
20:01 fbcit   14:52:14-13/11 [log] zebra_start /usr/share/koha/etc/koha-conf.xml 1.3.50
20:01 fbcit   fbcit:/usr/share/koha/etc/zebradb/etc# zebrasrv -c /usr/share/koha/etc/koha-conf.xml
20:01 fbcit   lrwxrwxrwx 1 root root    6 2007-11-13 14:51 default.idx -> us.idx
19:56 fbcit   might be somewhat dangerous, though.
19:55 fbcit   where 'foo' does the file moves?
19:55 kados   yea
19:55 fbcit   otherwise 'qx(sudo foo)'
19:54 fbcit   the password would be an issue....
19:53 fbcit   or sudo?
19:53 fbcit   can't we do 'su' inside a perl script?
19:53 kados   it's too bad the web installer couldn't have write access, this would be sooo much easier
19:53 kados   no sense writing code for something that doesn't work
19:52 fbcit   in theory... ;-)
19:52 kados   we should test to make sure that zebra won't complain if we use symlinks
19:52 kados   does that make sense?
19:52 kados   kinda like a2enmod
19:52 kados   and we could have a little utility to change them
19:51 kados   in theory that should work
19:51 fbcit   so have Makefile.PL build the correct symlinks?
19:50 kados   that'd be very apacheish
19:48 fbcit   interesting...
19:48 kados   ditto with the record.abs
19:48 fbcit   we could setup for multi-lang and wrap the marc issue up inside
19:48 kados   ie, symlink sort-string.chr to the appropriate language .chr file
19:48 kados   we might be able to do it with symlinks
19:48 kados   it depends
19:48 kados   well
19:48 kados   perhaps that's the best way to approach it
19:47 fbcit   so there is a diff default.idx per language?
19:46 kados   this is what makes zebra so great and at the same time so hard to set up
19:45 kados   and I'll have an arabic one by the end of next week
19:44 kados   that we should add
19:44 kados   there's a turkish one floating around as well
19:44 kados   sort-string-utf8.chr
19:44 kados   and that's the charmap that's defined there
19:44 kados   one type is 's' for 'sort'
19:44 kados   that's where the index types are defined
19:44 kados   if you look in default.idx
19:44 kados   stopwords specifically for sorting
19:43 fbcit   these are stopwords?
19:43 kados   yea
19:43 fbcit   I see.. hence the current suffix '_french'
19:42 kados   this is interesting
19:42 kados   and we ignore those for sorting purposes
19:42 kados   in English, The, the, a, A, An, etc.
19:42 kados   in France, articles are Le, La, Les, etc.
19:42 kados   are the articles
19:41 kados   the important differences between french and english
19:41 kados   it's language-specific
19:41 kados   ok, right
19:41 fbcit   k
19:40 kados   lemme check the frenh one
19:40 kados   in fact, it's entirely a language thing
19:40 kados   it's more a language thing
19:40 kados   the *.chr file isn't really a unimarc vs marc21 thing
19:39 kados   so this is interesting
19:39 kados   ok, sorry, had a phone call
19:37 fbcit   kados: so I'm going with -marc21 and -unimarc suffix's... see any problems?
19:35 kados   yes
19:32 fbcit   is this eq 'sort-string.chr'
19:32 fbcit   is this eq 'sortstring.chr'
19:32 fbcit   kados: in zebradb/etc I see sort-string-utf.chr...
19:30 kados   it's generic enough that it could be implemented for anything that needs spellchecking
19:30 kados   ie, not part of koha proper
19:30 kados   it's a separate 'service'
19:30 kados   I didn't add the sql to kohastructure.sql for 3.0
19:28 owen    Why doesn't it know those values?
19:28 owen    Oh, sorry, I wasn't thinking
19:28 kados   ' turn on by defining host:dbname:user:pass'
19:28 kados   see the syspref description :-)
19:28 kados   no
19:27 owen    Should that be a YesNo pref? Right now it's got a Textarea
19:27 owen    I see.
19:27 kados   owen: it tracks 'successful' queries and ranks them as part of the suggestion feature
19:26 kados   owen: it's just part of the functionality of that feature
19:26 owen    Why "track search queries" ?
19:26 kados   owen: I ported it to 3.0
19:25 kados   owen: yea, that's what NPL has
19:25 owen    kados, I was curious about the spelling suggest feature. When I look at the kohaspsuggest preference, its explanation is "Track search queries, turn on by defining host:dbname:user:pass"
19:25 kados   fbcit: your help with the installer is most appreciated
19:25 kados   fbcit: the liblimer's are doing code auditing this week of all the circ, searching, cataloging stuff
19:24 kados   fbcit: 3.0 is likely stable enough, or will be by the end of this week, to run in production
19:23 kados   yea, sounds perfect
19:22 fbcit   kados: sound ok?
19:22 fbcit   and do Pg port stuff in the cracks between...
19:21 fbcit   once that part works, we will work on the webinstaller part...
19:21 kados   we can delete misc/zebra altogether
19:21 kados   if we move those files to etc
19:20 kados   yep
19:20 fbcit   so *just* those three?
19:20 kados   those three files
19:20 kados   yes
19:19 fbcit   so really the fr stuff needs to be made to match what exists in etc/zebradb
19:18 kados   :-)
19:18 kados   sort-string.chr is referenced in default.idx which is referenced in bib1.att which is referenced in zebra-foo.cfg
19:18 kados   in a round abotu way
19:18 kados   well
19:18 kados   correct
19:17 fbcit   I assume these path/names are referenced in zebra-foo.cfg?
19:17 kados   not misc/
19:17 kados   and use the naming conventions from etc/zebradb
19:17 kados   it's just three files :-)
19:16 kados   ../../etc/zebradb/etc/sort-string.chr
19:15 kados   is the french version of
19:15 kados   misc/zebra/sort-string-utf_french.chr
19:15 kados   asap basically
19:15 kados   fbcit: this year for sure
19:15 kados   fbcit: 3.0 will be released when it's ready :-)
19:15 kados   but the usmarc file in that dir should be ignored
19:14 kados   so the unimarc record.abs is in koha/misc/zebra/record_authorities_unimarc.abs
19:14 kados   for authorities its
19:14 kados   for biblios
19:14 kados   so the unimarc record.abs is in koha/misc/zebra/record_biblios_unimarc.abs
19:14 fbcit   off-topic: what is the release time-frame for Koha3?
19:14 kados   yep
19:13 fbcit   we need to standardize I think... :-)
19:13 kados   and the english team has been using files in etc/zebradb
19:13 fbcit   famous last words.....
19:13 kados   we just discovered that the french team has been using files in misc/zebra
19:13 fbcit   I think this should not be too hard...
19:13 kados   ok
19:13 fbcit   give me path/filename of what changes per marc spec
19:13 kados   are marcflavour-specific
19:13 kados   all of the .chr files
19:12 kados   globals too :-)
19:12 fbcit   so only files under db/etc change for marc spec? or do some globals change also?
19:10 fbcit   k
19:10 kados   MARCFLAVOUR I think
19:10 fbcit   ?
19:10 fbcit   so we add ZEBRA_MARC or MARC_TYPE
19:10 kados   unimarc is pretty localized to france
19:09 kados   marc21
19:09 fbcit   kados: is marc21 default or unimarc?
19:04 fbcit   I'm for leaving it in the db for now...
19:03 kados   correct
19:03 fbcit   koha-conf.xml contains settings the user should not be able to change, right?
19:02 kados   but that would require a fair amount of refactoring
19:02 kados   rather than in the systempreferences
19:02 kados   we could almost store that in the config file
19:02 kados   yea, I like that idea too
18:59 fbcit   and webinstaller checks as we discussed earlier...
18:59 fbcit   with what I know at this point, I like the idea of an env var passed to Makefile.PL
18:58 kados   if we solve the prob for record.abs we can solve it for the others
18:58 kados   yea, there are only two others
18:58 kados   my thinking is
18:58 fbcit   and other associated config files...
18:58 kados   exactly
18:58 fbcit   our problem is how to decide which record.abs to install...?
18:58 fbcit   k
18:57 kados   yea
18:57 fbcit   so the only diff between unimarc and marc21 is the "tag" (ie 100$a)?
18:57 kados   it's unfortunately a bit more complex than that
18:56 kados   well, not quite
18:54 fbcit   xslt
18:54 fbcit   so 'abs' is just a diff format than sxml...
18:53 kados   yep
18:51 fbcit   yea
18:51 kados   with me so far?
18:51 kados   will be different depending on the flavour of MARC
18:51 kados   so koha/etc/zebradb/foo/etc/record.abs
18:51 kados   whereas in marc21, it is
18:51 kados   because, for instance, in unimarc 100$a isnt' author
18:51 kados   so marc21 and unimarc have different indexes obviously
18:50 kados   (but lets keep it simple for now)
18:50 kados   (well, foo.abs really)
18:50 kados   record.abs is the master index definition for a given database
18:50 kados   yes
18:50 fbcit   so koha/etc/zebradb/foo/etc?
18:50 kados   one of the files in particular is used to define how zebra indexes things
18:49 kados   and koha/etc/zebradb/biblios/etc has the biblios-specific config files
18:49 kados   you'll see an etc dir with the global configs
18:49 kados   if you look in koha/etc/zebradb
18:49 kados   with database-specific config files
18:49 kados   and biblios and authorities have their own etc as well
18:48 kados   so we have a generic global etc dir with global config files
18:48 kados   one for biblios and one for authorities
18:48 kados   in Koha we have two databases currently
18:48 kados   so some stuff can be set globally and some stuff set per-database
18:48 kados   it's very very flexible
18:47 kados   zebra has config files and system files
18:47 kados   ok, here goes
18:46 kados   studying it probably will take you a couple weeks :-)
18:46 kados   I can explain zebra
18:45 fbcit   I need to spend time studying how zebra is setup and how ExtUtils::MakeMaker works
18:44 kados   any thoughts since lunch? :-)
18:44 kados   so we still need to address this prob with marc21 vs unimarc
18:44 kados   fbcit++
18:44 kados   ok, I'm gonna push this stuff up
18:43 fbcit   :-)
18:43 fbcit   git had me running scared...
18:43 kados   but I'll take a look
18:43 kados   I thought galen pushed up a patch for that
18:43 fbcit   havn't taken time to look
18:43 kados   ahh
18:42 fbcit   sample_labels.sql tries to dup a key I think...
18:42 kados   but other than that we're all good
18:42 kados   sample_labels.sql failed
18:42 kados   yea, it's all working
18:42 kados   sweet
18:40 fbcit   kados: so if no port is spec'd (ie. <port></port>) with mysql it will not matter
18:39 fbcit   back
18:38 fbcit   kados: one moment...
18:35 kados   send it to rm@koha.org
18:35 kados   yea, I don't see that one
18:35 fbcit   I can resend it...
18:34 kados   ok, give me a sec here
18:34 kados   I see now
18:34 kados   hang on
18:34 kados   hmmm
18:34 kados   fbcit: I didn't get that one
18:34 [K]     *** part FreeNode!#koha: darcilicious n=plinkit@159.121.122.150
18:33 fbcit   second patch down... ;-)
18:33 fbcit   0002-Moved-language-dirs-one-level-down-under-dbms-dir-m.patch
18:33 [K]     *** join #koha@FreeNode: darcilicious n=plinkit@159.121.122.150
18:33 kados   sorry for bothering you about it :-)
18:32 kados   ok, i'll see what I'm missing here
18:32 kados   yea
18:32 kados   the en stuff is still in the data dir
18:32 fbcit   and that is why no marc choices....
18:32 fbcit   then a patch failed
18:32 kados   fbcit: maybe I'm missing a patch?
18:32 kados   fbcit: it's not there
18:29 fbcit   check for the existence of koha/installer/data/mysql/en/marcflavour...
18:29 kados   you can run the installer
18:29 kados   fbcit: http://staff-jmf.dev.kohalibrary.com
18:28 fbcit   it should work w/o a port spec'd as installer checks for $info{port} ? "port=$info{port}":"" but that is not the problem here I think
18:27 kados   that's a new parameter, not everyone will know that it needs to be in there
18:27 kados   if that makes sense
18:27 kados   ok, but what I mean is, we shouldn't have to specify the port in the config file
18:27 fbcit   hold on....
18:26 fbcit   Makefile will set the port to the default mysql if none is specified.
18:26 kados   ] install.pl: no open /home/jmf/koha/production/intranet/cgi-bin/installer/data/mysql/en at /home/jmf/koha/production/intranet/cgi-bin/installer/install.pl line 477., referer: http://staff-jmf.dev.kohalibrary.com/cgi-bin/koha/installer/install.pl?step=3&op=choosemarc
18:26 kados   [Tue Nov 13 12:21:09 2007] [error] [client 96.230.90.54] [Tue Nov 13 12:21:09 2007] install.pl: no open /home/jmf/koha/production/intranet/cgi-bin/installer/data/mysql/en/marcflavour/ at /home/jmf/koha/production/intranet/cgi-bin/installer/install.pl line 418., referer: http://staff-jmf.dev.kohalibrary.com/cgi-bin/koha/installer/install.pl?step=3&op=choosemarc
18:26 kados   for backwards compatibility
18:25 kados   and while I like the idea of being able to specify the port, it should work without that specification
18:25 kados   but nothing to actually select
18:25 kados   as a step
18:25 kados   Select your MARC flavour
18:25 fbcit   k
18:25 kados   I get:
18:25 kados   when I run the web installer
18:25 kados   I'm testing mysql
18:25 kados   I'm not testing Pg
18:25 kados   hmmm
18:24 fbcit   also set <port>5433</port> for Pg
18:24 fbcit   kados: you have to make the db selection in koha-conf.xml... <db_scheme>Pg</db_scheme>
18:24 kados   basically I'm not prompted to select a MARC flavour, and I'm not prompted to select my 'options'
18:24 kados   fbcit: and there are some bugs
18:23 kados   fbcit: and I applied everything
18:23 kados   fbcit: chris just forwarded me all your patches
18:23 kados   fbcit: see above
18:23 kados   hiya
18:22 kados   also, step 3, doesn't list any options to select from
18:21 kados   fbcit: I don't get the option to select a marc flavour (it asks me to select, but no options are listed)
18:21 kados   fbcit: I'm seeing one bug here with these patches
18:21 kados   fbcit: back yet?
17:28 kados   and yea, I'm stuck on step 2
17:28 kados   it's just finding my mysql db
17:27 kados   (I think I'm missing the 'select your database type' one
17:27 kados   fbcit: but I may be missing some
17:27 kados   fbcit: I'm testing out your patches
17:27 kados   fbcit: ping me when you're back
17:23 kados   owen: no
17:21 owen    kados, is the redirect from /search going to be done for the 3.0 OPAC ?
17:12 fbcit   :-)
17:12 kados   yea, on my list
17:12 kados   awesome
17:12 fbcit   changing to tmp fixed it, so I'll add the code this afternoon.
17:11 fbcit   I added a library over pg last night and nothing blew chunks
17:11 kados   fbcit++
17:10 kados   around line 411
17:10 kados   C4/Auth.pm
17:10 kados   we need a block to handle postgres
17:10 kados   ahh
17:10 kados   or ... you could test if it's that by setting it to tmp for now
17:09 kados   I think
17:09 kados   mysql|tmp|postgres
17:09 kados   yea, just change that to:
17:09 fbcit   mysql|tmp
17:09 fbcit   sessonstorage
17:09 kados   fbcit: SessionStorage
17:09 kados   fbcit: /cgi-bin/koha/admin/systempreferences.pl?tab=Admin
17:08 kados   or you could just change it to file
17:08 kados   we probably need to add an option for postgres
17:08 kados   I bet it's set to mysql
17:08 kados   there's one for session driver
17:08 kados   check your syspref
17:06 fbcit   it is, but I am not familiar with that module myself..
17:05 kados   I guess it's based on ExtUtils::MakeMaker
17:04 kados   hmmm
17:02 fbcit   and koha runs like normal...
17:01 fbcit   kados: 'make uninstall' says: Uninstall is unsafe and deprecated, the uninstallation was not performed.
17:00 fbcit   it does no look like it.
16:59 fbcit   I don't know, hold on.
16:58 fbcit   it could be made to...
16:58 kados   so I can't do a 'make uninstall'?
16:58 fbcit   kados: no
16:58 kados   cya hdl
16:58 fbcit   s/by/bye/
16:58 fbcit   by hdl
16:58 hdl     see you.
16:57 kados   fbcit: does the make install process output a result txt file that says what was done?
16:56 kados   hdl: the only file-system stuff is zebra's .abs file and the .chr files
16:56 kados   hdl: yes, they will be fine, all of that is handled in the database
16:56 kados   fbcit: right
16:56 hdl     But marc frameworks won't be good.
16:56 fbcit   so user's pref will rule when data entry is concerned, but not when searching..
16:56 kados   and if the user chooses nozebra it doesnt' matter anyway
16:56 hdl     you're right.
16:56 hdl     Oh yes.
16:55 kados   regardless of the system-level choices
16:55 hdl     kados : addbiblio.pl adds 100$a
16:55 kados   if the user chooses unimarc, the data will be saved as unimarc
16:55 kados   fbcit: right, data entry will be unaffected
16:55 hdl     fbcit:  yes it will
16:55 kados   fbcit: zebra only comes into play when searching
16:55 fbcit   data entry will not be affected?
16:55 kados   that tells the user that someting's not configured correctly
16:55 fbcit   so marc only comes into play when searching?
16:55 kados   maybe have a big warning on the staff side though
16:55 fbcit   k
16:55 kados   just not searching
16:54 fbcit   sp...
16:54 kados   because other still will work fine
16:54 fbcit   as long as the descrepancy exists?
16:54 kados   well, probably not
16:54 kados   maybe
16:54 fbcit   ?
16:54 fbcit   and refuses to run....
16:54 kados   and if they dont' match, it warns the user to have their sysadmin fix it
16:54 kados   when the web installer is run, it checks the user's choice vs the system choice
16:53 fbcit   we could insert the marcflavor pref there....
16:53 kados   defaults to marc21
16:53 kados   __MARCFLAVOUR__
16:53 fbcit   too bad kohastructure is not in place during Makefile.PL...
16:53 kados   we can use a new variable for the makefile
16:53 kados   maybe that's the approach to take
16:53 kados   yea
16:52 fbcit   webinstaller just needs to verify that the marcflavor the user wants is what has been installed and warn otherwise...
16:52 kados   yep, because it requires write access to the filesystem
16:51 fbcit   so the zebra stuff must be done in Makefile.PL...$
16:51 kados   we want to maintain a separation between system-level and library-level tasks
16:51 hdl     fbcit: this is what we are heading to.
16:51 kados   fbcit: yes
16:51 fbcit   and the user to run webinstaller?
16:51 hdl     (Nope was for me... Mys solution required a change in koha.xml)
16:51 kados   fbcit: yes
16:51 fbcit   kados: are we expecting the sysadmin to run make && make install?
16:50 hdl     Nope.
16:50 hdl     and zebra-biblios-unimarc.conf
16:50 hdl     zebra-biblios-usmarc.conf
16:49 kados   1. default to marc21 and have the web installer warn the user upon unimarc choice to tell the sysadmin to run a script that installs unimarc files
16:49 hdl     if one created 2 zebra-biblios.conf files
16:49 kados   so we can:
16:48 kados   (I think that's it)
16:48 kados   anything else?
16:48 kados   yep, so the .abs and the .chr files
16:48 hdl     ...
16:48 hdl     words.chr
16:48 hdl     sortstrings.chr
16:48 kados   hdl: more than record.abs?
16:48 hdl     And zebra requires a different configuration file if it is UNIMARC or usmarc.
16:47 kados   so that's what we're trying to resolve
16:47 kados   exactly
16:46 hdl     Yes. But info tech Guy has no way to choose between UNIMARC and usmarc.
16:46 kados   perl Makefile.PL; make; make install
16:46 kados   there is zero zebra config necessary
16:46 kados   the Makefile.PL does everything
16:46 kados   hdl: that's it
16:46 kados   hdl: the install process is 'make' 'make install'
16:45 kados   hdl: so what I'm trying to say is, we need a way to make it possible to install a unimarc record.abs in the main project installer
16:45 hdl     your install process is documented ?
16:45 kados   hdl: exactly
16:45 kados   hdl: the install process for you and paul is documented on the wiki, right?
16:45 hdl     If you have to set up a UNIMARC library, you will require a UNIMARC record.abs
16:44 kados   http://www.pathname.com/fhs/
16:44 kados   Filehttp://www.pathname.com/fhs/
16:44 hdl     paul and I works with UNIMARC it has nothing to do with our way to install.
16:44 kados   and in zebradb/biblios/etc we have the database-specific config files
16:44 kados   inside zebradb we have an etc with all of zebra's config files
16:44 kados   hdl: slef has worked hard to conform to the FSH for all naming conventions
16:43 kados   hdl: you will find koha-conf.xml and koha-httpd.conf that Makefile.PL use
16:43 kados   hdl: take a look at koha/etc
16:42 kados   hdl: I think the issue here is that you and paul hav a different process for installing zebra than the rest of us
16:42 fbcit   Makefile.PL could tell zebra where zebra-biblio.conf is?
16:41 kados   koha/etc/zebradb/
16:41 kados   tab is now called etc
16:41 hdl     record.abs in in tab
16:41 kados   hdl: ok, but who has write access to zebra-biblio.conf?
16:40 hdl     And zebra-biblio.conf could settle which one to use.
16:40 kados   s/tab/etc/
16:40 hdl     I think that there could be two *.abs files in tab dir.
16:39 hdl     I mean :
16:39 hdl     I think that we donot use zebra configuration files possibility at their top level.
16:39 fbcit   I need to study the zebra config stuff more closely.
16:39 kados   although perhaps it could be useful for re-indexing
16:39 kados   hdl: rebuild_zebra.pl is unnecessary for installation with Makefile.PL
16:38 hdl     But
16:38 kados   at least it doesn't as currently designed
16:38 hdl     I donot have time enough to investiguate in zebra installation script.
16:38 kados   because the web installer doesn't have write access to those dirs
16:38 hdl     Ok.
16:38 fbcit   so why not have the webinstaller do it all?
16:38 kados   hdl: it sets up everything
16:37 kados   hdl: yep
16:37 hdl     kados : Does it setup a zebra-biblios.conf ?
16:37 kados   he needs a record.abs that is unimarc-specific
16:37 kados   that doesn't work for hdl
16:37 kados   and the record.abs it puts in there is a marc21 one
16:37 kados   it puts record.abs in the zebradb/biblios/etc/ dir
16:37 kados   it sets up zebra for you
16:36 kados   when you run Makefile.PL
16:36 kados   here's the real issue
16:36 kados   ok
16:36 fbcit   to the start of the marc21 and unimarc sql scripts...
16:35 kados   fbcit: moved it where?
16:35 fbcit   minimizes changes...
16:35 fbcit   hdl, kados: I moved the pref insert as I mentioned and it works fine...
16:34 kados   hdl: what's your idea to solve this problem?
16:33 kados   maybe
16:32 kados   so if we create two dirs, then the librarian can choose with a syspref which one to use
16:32 kados   3. the librarian has no way to set up zebra's databases
16:32 kados   2. the system person won't know what marcflavour to use
16:32 kados   1. we want to separate library choices from system choices
16:32 hdl     kados: i really donot see why we should even create a ghost database.
16:32 kados   the problem right now with installation is that:
16:30 kados   that happened to not have anything in it
16:30 kados   it would just be a directory
16:30 kados   well, not really, it wouldn't ever be initiatlized
16:30 hdl     you would create a database just for 'fun'.
16:29 hdl     imho, it would be crazy and nonesense.
16:29 kados   does that make sense?
16:29 kados   and let the user choose which one to use
16:29 kados   it would just install both databases
16:29 kados   the Makefile woudln't need to know about the choice up front
16:28 kados   then the syspref could be used
16:28 kados   ie, biblios-marc21 vs biblios-unimarc
16:28 hdl     kados ????
16:28 kados   but what if we solved this by having different databases for unimarc vs marc21
16:28 hdl     Adding one line from a different table.
16:28 kados   ok, this may sound strange
16:27 hdl     Since exporting frameworks from bases is quite easy and automatic.
16:27 hdl     fbcit: yes. It may be the most appropriate way. But it would need documentation and much caution from devs.
15:56 fbcit   at the top of each we could insert the appropriate preference...
15:55 fbcit   those scripts will be selected based on the user's choice...
15:55 fbcit   I wonder if we can move that insert into the marc21 framework & unimarc framework sql rather than doing it in install.pl?
15:53 fbcit   ahh... I see...
15:52 hdl     This is why I added this line in install.pl
15:52 hdl     But if we have only one systempreferences.sql for english ppl, then marcflavour would be wrong sometimes (when someone chooses UNIMARC)
15:51 hdl     *in english*
15:51 hdl     fbcit: If unimarc_standard_systempreferences.sql in english adds a marcflavour UNIMARC, then inserting marcflavour line in install.pl is nonsense.
15:48 fbcit   but the marcflavour preference is populated by unimarc_standard_systemprefs.sql so why do we need to do the insert in install.pl
15:48 hdl     It is english marcflavour choice which raises this error.
15:47 hdl     So choice of marcflavour is skipped.
15:47 hdl     But french install donot have more than one marcflavour.
15:47 hdl     yes
15:47 fbcit   hdl: I notice that in the fr/mandatory there is unimarc_standard_systemprefs.sql which also inserts marcflavour
15:41 fbcit   the first is just there in case there is not a second... right?
15:40 fbcit   that would be true if the second always takes precedence (which it seems to me to... :-)
15:39 hdl     Maybe we should insert IGNORE rather than only inserting
15:39 kados   hdl: regarding your question, yes, we have a customer that wants that
15:39 fbcit   or can the first insert be made conditional on the language choice?
15:38 fbcit   hdl: but the error is carried out to the user... should it be suppressed?
15:36 fbcit   hdl: sorry about that...
15:31 hdl     ok
15:31 fbcit   hdl: sorry, but I have to run... I'll get back later.tnx
15:30 hdl     shouldnot be that way. Second insert should be and is discarded
15:29 fbcit   really we can do one of two thing, imo...
15:26 fbcit   hdl: in the case of marcflavour, the second insert takes precedence, right? (that one in sysprefs.sql)
15:10 hdl     Can I get on your system ?
15:09 owen    I can't reproduce this problem with the default framework I have. Do you have any suggestions?
15:09 hdl     Which is NOT the expected behaviour : should be all subfields displayed and not only optional ones.
15:08 hdl     If you click on field 245 for instance, then mandatory subfields fades away and optional ones are displayed.
15:07 owen    No
15:07 hdl     owen : have you tried to add a biblio with only title and doctype mandatory ?
15:04 owen    hdl, maybe you can help me understand bug 1513?
15:04 hdl     not today
15:03 owen    paul_ around?
15:01 hdl     (For instance for childhood protection or for restricted areas)
15:01 hdl     (restricted search)
15:00 hdl     Does any of your customer want to limit results to some subset ?
15:00 hdl     kados ?
14:43 hdl     ?
14:43 hdl     kados : would the BIG xslt containing ALL the frameworks be processed once for all  (when setup is complete or marcflavour chosen) ? or should xslt processed at each connexion (This would take time.)
13:53 kados   which could be set up ahead of time presumably
13:52 kados   The <extract> pipeline takes documents from any common DOM XML format to the Zebra specific indexing DOM XML format. It may consist of zero ore more <xslt stylesheet="path/file.xsl"/>  XSLT transformations, and the outcome is handled to the Zebra core to drive the process of building the inverted indexes.
13:52 kados   but we could have multiple extract pipelines
13:47 kados   it would have to be in zebra.cfg
13:47 kados   hmmm, guess not
13:45 kados   hdl: because in the DOM you could have the choice stored in a syspref
13:45 hdl     See you soon
13:45 hdl     How would you have both in DOM ?
13:44 kados   so which is easier?
13:44 kados   if we use ABS we have to modify Makefile to accomodate for the choice
13:44 kados   if we switched to DOM we could have both, and make the choice in the web installer
13:44 hdl     tumer already did it.
13:44 kados   (not the web installer)
13:44 kados   in the installer
13:44 kados   well the question is, how do we handle unimarc vs usmarc
13:43 hdl     I agree with this change.
13:43 hdl     changing all the stuff for DOM is not a vital priority.
13:43 kados   but it's a programatic change
13:43 kados   yep
13:43 hdl     But at the moment, we need a release don't we ?
13:42 hdl     kados : Sure.
13:40 mj      hdl: thanks for the tip.
13:39 kados   I think there are aspects of the Koha frameworks that could fit into the zebra xslt DOM file
13:36 kados   do we use record.abs for anything except zebra indexing?
13:36 hdl     but for install, it is the problem I spotted ;) ... friendly
13:35 kados   hdl: right, but for zebra it's just indexing
13:34 hdl     kados : marcflavour is not only for indexing, it is also related to framework building.
13:33 kados   http://wiki.koha.org/doku.php?id=zebraprogrammerguide#how_do_we_convert_from_abs_to_dom_style_indexing
13:32 kados   hdl, fbcit-away the solution is to switch from ABS to DOM :-)
13:32 kados   hdl, fbcit-away  I think I have a solution to the difficulty of picking how to have a different record.abs between unimarc and usmarc
13:32 owen    Hi
13:31 kados   hiya owen
13:10 hdl     fbcit-away: hope you shall get this message soon.
13:10 hdl     But Problem would be if no choice of marcflavour is proposed (For french it is the case). Then marcflavour should be imported from systempreferences.sql
13:06 hdl     In fact, systempreferences.sql could be updated in order not to insert marcflavour systempreference.
13:05 hdl     This makes the problem occur.
13:05 hdl     I changed install.pl to insert marflavour when one was chosen.
13:05 hdl     fbcit-away:
13:00 fbcit   looking at the structure of systempreferences, it does not make any sense. sysprefs.sql should import without error...
12:53 fbcit   looks like it would insert in spite of the complaint since prior to the sql import we SET FOREIGN_KEY_CHECKS=0
12:50 fbcit   grep'ing only shows that one occurrence though...
12:48 fbcit   is it possible that the row is inserted by an earlier script and duped in the sysprefs script?
12:47 hdl     Oh... Yes.
12:47 hdl     if mysql complains about duplicate key value, then it doesnot add.
12:46 fbcit   hdl: I thought this might have something to do with the marc flavor changes
12:42 fbcit   However, doing a select on systempreferences.variable = 'marcflavour' returns only one record...
12:42 fbcit   'marcflavour'
12:41 fbcit   line 49
12:40 fbcit   specfically
12:40 fbcit   I was testing changes I made to the installer and noticed mysql complaining about dup keys in the sysprefs.sql
12:38 hdl     hi fbcit
12:38 fbcit   g'morning hdl
12:21 hdl     This is owed to a change in config syntax
12:21 hdl     consider commenting the passw.passwd line in zebra-biblios.cfg
12:20 hdl     mj
12:20 hdl     ùj hi
11:23 mj      I promise: when I have all this up-and-running, I'll create a wiki page with detailed instructions :-)
11:23 mj      any ideas here what else i missed?
11:22 mj      now I'm getting: 11:23:43-13/11 [fatal] /usr/share/koha/etc/zebradb/zebra-biblios.cfg:29 missing colon after 'passw.passwd'
11:22 mj      thanks very much, that seems to work much better, however...
11:21 mj      hello. I am the person who asked the "zebrasrv -c" question on the mailinglist, and received the tip to try "zebrasrv -f" instead from Henri-Damien