IRC log for #koha, 2008-07-24

All times shown according to UTC.

Time S Nick Message
12:07 cnighs g'morning #koha
12:10 paul kados around ?
12:10 paul hi cnighs
12:10 paul does any liblimer have a an idea of the size of a Koha setup with, say, 1 000 000 biblios, and 3 000 000 issues a year ?
12:10 paul (the disk size, mySQL & zebra)
12:49 gmcharlt good morning #koha
12:49 paul hi gmcharlt
12:49 gmcharlt paul: don't have the numbers offhand - atz, ryan, or cfouts might have them
12:49 paul cfouts ?
12:52 gmcharlt cfouts = Clay Fouts, a new sysadmin for LL - not sure if he goes on #koha that often
12:56 slef paul: I'd expect disk type (RAID is almost essential, but speed and layout matter too) and CPU speed/number to also come into play at that size, based on past experience with webservers.
13:19 kados paul: with that many transactions you definitely want zebra and mysql on separate disks, probably separate servers
13:19 kados paul: otherwise zebra's indexing will compete with mysql for disk IO
13:35 paul kados : thanks for the idea.
13:35 paul can you tell me for the size ?
15:00 kados owen: you there?
15:00 kados owen: 'patrons have been successfuly moved to trash'
15:01 owen :)
15:01 kados owen: that just doesn't quite capture what we're doing and if we're going to change that, I think we should change it 'right' :-)
15:01 owen Doesn't sound very nice for the patrons
15:01 kados hehe
15:01 kados how about patron accounts have been deleted
15:01 kados or anonomyzed even
15:01 kados however you spell that
15:02 owen Is this under clean borrowers?
15:04 owen I see both "deleted" and "moved to trash" in the template, based on <!-- TMPL_IF NAME="trash" -->
15:04 owen What does that mean?
15:05 kados paul: ?
15:05 paul mmm... no idea either. It's something written by toins
15:05 paul maybe it's :
15:05 paul 1st step (confirm what we will clean) and 2nd step (really delete)
15:05 paul ?
15:06 owen What does it mean when patrons are "moved to the trash?"
15:06 kados deletedborrowers table I bet
15:06 owen "What do you want to do for deleted patrons?  Permanently delete these patrons   Move these patrons to the trash"
15:06 eric_ anybody knows where i can find a list of what type of marc is used in a country?
15:07 paul owen: no idea, sorry
15:08 eric_ owen: Could it mean that the patrons is "deactivated", but all its information is still in the database?
15:12 owen CVS history says cleanborrowers.pl was added by toins
15:13 kados owen: I bet it moves them to the deletedborroweres table
15:13 owen Shouldn't that just be the default action?
15:14 kados if there was one
15:14 owen I hate to reference "the trash" when there's no mechanism from the interface for retrieving records from "the trash"
15:15 su-erin any tips for trouble shooting this upgrade from .064 to .094 on ubuntu 7.10:  Can't open blib/ZEBRA_CONF_DIR/etc/passwd for read at rewrite-config.PL line 168.
15:27 eric su-erin, the first thing to do is to check if the file exists (I guess you check that already, right).
15:27 eric It should be in the directory where you untar koha
15:45 atz then check if you can read it  :)
15:47 su-erin rewrite-config.PL is there and I have opermission to read it; check that yesterday. I think it has something to do with the that ZEBRA_CONF_DIR. I just dont know what directory that should be
15:51 atz usually in your koha (kohaclone, whatever) directory as   ./etc
15:55 paul kados ? about your patch UTF-8 to ASCII MAPPINGS. I don't understand why you need equivalent AND map.
15:55 atz paul: i think map is a one-way relationship
15:56 atz so if I search by e, it will match on acute-e, but not vice versa
15:56 atz i'm not sure why we would need both though, if there are duplicates
15:57 paul in french .chr, we use only map, and it work fine
15:57 paul head/etc/zebradb/lang_defs/fr/sort-string-utf.chr
15:57 atz su-erin: for example:  ~/kohaclone/etc/zebradb/
15:57 paul (used also for word-phrase-utf.chr)
16:02 atz paul: we also ran into differences between wide-bytes and combined characaters
16:02 atz but maybe we would be fine to just use the mappings you have in the french file
16:02 su-erin thanks, i'll dig their
16:02 su-erin *there
16:20 kados paul: note that only covers sorting, not searching
16:21 kados paul: do you have a custom word-phrase-utf.chr that you use for French libraries too?
16:21 paul kados : what cover sorting not searching ?
16:21 kados sort-string.chr
16:21 kados it's not used for equivalance in searching, only sorting
16:21 paul nope, we use the same file content (although we have a word-phrase-utf)
16:21 paul but it's content is the same as sort-phrase-utf.chr
16:21 kados then only word-phrase-utf should be used for searching according to default.idx
16:22 paul right.
16:22 kados word phrase numeric indeces are separaet from sort indeces
16:22 paul but the content of both files are the same
16:22 paul (not sure to understand what you mean...)
16:23 kados different rules are used for different indexes and therefore, actions
16:23 kados rules that apply to sorting don't apply necessarily to searching
16:24 paul yep, I know
16:24 kados for instance, in English, we want to be able to search for 'The', but we don't want 'The ' to be counted for sorting purposes
16:24 paul but for us, the same rules are OK. so the files have the same content.
16:24 paul mmm... the is in empty words, isn't it ?
16:24 paul so it's discarded ?
16:25 kados paul: so you use sort-string.chr also for word-phrase-utf.chr?
16:25 kados because those two files in default Koha are different
16:25 paul yep
16:25 kados OK, so that's a local modif you do apart from normal installation
16:25 kados (just trying to understand clearly)
16:25 atz kados: so their config references the same file in 2 places
16:25 atz rather than 2 separate files
16:25 atz iiuc
16:25 kados you edit default.idx and point word and phrase indexes to sort-string.chr
16:26 kados ?
16:26 paul nope.
16:26 paul we refer to sort-string.chr & word-phrase.chr
16:26 paul but those 2 files contains the same thing (map, equivalent...)
16:26 kados OK, so you copy sort-string.chr to replace word-phrase-utf.chr then?
16:27 kados paul: the same type of file, yes but in default Koha they have very different rules, esp the French sort-string.chr and default word-phrase-utf8.chr
16:27 paul I should do an install from scratch to check
16:27 kados and your sort-string.chr has mappings for French words like Le
16:27 kados do you want those to be ignored in searching as well as sorting?
16:27 kados (that would be surprising to me)
16:27 atz paul: yes, please.  your familiarity w/ this issue will help out considerably
16:28 paul kados : yes, that's what I want
16:28 paul (ignore Le when searching & sorting)
16:28 paul + we always use empty word removal, so "Le" is not sent to zebra anyway for searching
16:28 paul (so it's usefull only for sorting in fact)
16:28 kados k
16:29 kados paul: OK, so I bet that it doesn't work for you because only sort-string.chr is used and only for sorting, not searching
16:29 kados all searching uses word-phrase-utf.chr
16:30 kados for english and french it appears
16:30 paul (I didn't say it don't work for us. I just investigate the consequences of the commit for us ;-) )
16:30 eric (for the record, when paul talks about <empty words>, he is refering to <stop words>)
16:30 paul eric : right
16:30 kados maybe we should move word-phrase-utf.chr to the lang_defs/fr and lang_defs/en
16:30 paul (empty word is a frenchism..)
16:31 paul kados : maybe yes.
16:31 eric Paul, is there a reason why you don't want to sort using the stop words?  I can understand the search, but for the sort, i<m not sure...
16:32 kados eric: 'Le ' is an article and most librarians don't want it to be used for sorting
16:32 kados s/it/articles/
16:33 paul eric : "Le Seigneur des anneaux" must appear at "S" for sorting
16:34 kados paul: maybe we should move word-phrase-utf.chr to the lang_defs/fr and lang_defs/en
16:35 kados paul: to accomodate your need to not search by articles etc
16:35 paul kados : didn't you write that 3mn ago already ? and I answered "maybe yes"
16:36 kados hehe, maybe :-)
16:36 paul kados : in fact, I don't care having map Le^ ^, for searching, as Le is already removed by Koha before sending the request to zebra
16:36 paul but I agree it's a good idea.
16:36 paul (more flexible for the future probably)
16:38 nicomo yes because you (paul) speculates that the stop-words list will be correctly filled in by the librarian: not a sure bet
16:38 nicomo so having map Le for seraching might provide a safety net too
16:39 gmcharlt respecting nonfiling indicators would be better yet, although a 3.2/DOM-mode thing
16:39 nicomo gmcharlt ++
16:48 eric anybody knows the usage of 908$a - Put Command Parameter?
17:13 cnighs hdl about?
17:44 paul cnighs: hdl was at a client today. should be back tomorrow
17:44 paul or maybe will jump in for a few minuts in 2 hours or so (although it's already 8PM here)
17:45 cnighs tnx paul
19:31 atz acmoore: trying out overdues script for a client...
19:31 atz all the <<branches.*>> elements seem not to get populated?
19:31 atz seen that before/
19:31 atz ?
19:36 acmoore atz, hmm. No, I haven't. In fact, I have branches.branchphone in the template I've been testing with, and it gets popualted.
19:36 acmoore I wonder what more I can look at with you.
19:37 atz let me check their branches table....
19:37 acmoore atz, do they get removed?
19:37 atz yeah, they don't appear in the resulting messages, just an empty line
19:38 acmoore atz, are you supplying a --library flag to the script to limit it to one branch, or running it on all branches?
19:38 atz running it for all
19:39 acmoore hmm.. odd. I don't knwo what might be up. I wonder if the same thing happens if you limit it to one branch.
19:39 acmoore I guess one thing to check is that the field you're looking for is actually populated in the branches table.
19:40 atz yep, that's why I went to check.  looks normal to me
19:40 atz mysql> select * from branches;
19:40 atz +------------+--------------+--------------​-------------+----------------+------------​----+-------------+-----------+------------​----+---------+----------+---------------+
19:40 atz | branchcode | branchname   | branchaddress1            | branchaddress2 | branchaddress3 | branchphone | branchfax | branchemail    | issuing | branchip | branchprinter |
19:40 atz +------------+--------------+--------------​-------------+----------------+------------​----+-------------+-----------+------------​----+---------+----------+---------------+
19:40 atz | LCC        | Main Library | DeFehr Building 3rd Floor | Kretingos 36   | Klaipeda, LT   |             |           | library@whatever.com |    NULL |          |               |
19:40 atz | TXT        | Textbooks    | DeFehr Building Basement  | Kretingos 36   | Klaipeda, LT   |             |           | library@whatever.com |    NULL |          |               |
19:40 atz +------------+--------------+--------------​-------------+----------------+------------​----+-------------+-----------+------------​----+---------+----------+---------------+
19:41 atz (emails changed to protect the innocent)
19:41 acmoore are you attempting to use branchphone? ;)
19:41 atz would that prevent branchname from displaying?
19:42 acmoore ah, no. I just didn't know what field you were trying to use, and branchphone appears to not be populated.
19:42 atz the odd thing is that *none* of the branches.* fields display
19:44 acmoore atz, can you run it with the --library=LCC or --library=TXT  set to see if it works? Is this a pain for you to do?
19:44 atz probably this line:   @branches = ('');
19:45 acmoore I've noticed that some people use a branchcode of '' for a default in their databases, and perhaps leaving it off is suppoosed to be running for that default branch instead of all branches.
19:45 eric do you know what the issuing column?
19:46 atz acmoore: that is probably inconsistent... in rules that should be NULL, as in UNMAPPED to branches table
19:46 atz "" is an illegal value (foreign key violation)
19:48 atz eric: i imagine that field is meant to designate whether the branch is a circulating one or an internal one (like bindery, cataloguing, etc.)  
19:49 atz i'd bet it isn't used (anymore) though.  much like branchprinter.
19:49 acmoore atz, oh, I see. well, I wonder how this should work, then. I guess not specifying branchcode to this script should run for all branches, but that appears to be a bug, then?
19:49 atz acmoore: no luck w/ --library options
19:49 acmoore atz, when you say no luck, do you mean that it continues to fail to substitute the branches.* fields?
19:49 atz acmoore: it still runs, and it populates w/ patron and item data.  but the branches.* lines are still blank
19:50 atz in short, yes.
19:50 atz :)
19:50 acmoore odd.
19:51 atz just rebased this afternoon, btw
19:51 acmoore the -v flag isn't too great, but if you want me to keep looking at it with you, could you run it with one library and the -v flag and send me the results, please?
19:52 acmoore I'm just not sure if they'll be useful enough for you to decypher.
19:52 atz acmoore: it's possible that the *borrowers* are sparsely populated and there isn't a homebranch recorded
19:52 atz let me check that
19:54 atz nope... looks like they all belong to the main branch.  
19:55 atz which is odd, b/c I still get results with --library=TXT ... must be because the items that are overdue are TXT's
19:57 atz well, the error message is on point:
19:57 atz The following terms were not matched and replaced:
19:57 atz        branches.branchname
19:57 atz        branches.branchaddress1
19:57 atz        branches.branchaddress2
19:57 atz        branches.branchaddress3
19:57 atz        branches.branchphone
19:57 atz        branches.branchemail at /home/liblime/kohaclone/misc​/cronjobs/overdue_notices.pl line 383.
20:00 atz also distressing, since I ran in -n (no effect mode), I see lines like :  debarring 48 Irma BALCIUNAITE
20:01 acmoore -n is No email.
20:01 acmoore perhaps that should change, though.
20:06 atz hmmm.  ok, i have the log from that and can un-debar the 10 or so patrons impacted
20:07 atz acmoore: so there is no test mode?
20:08 acmoore i guess not. There's just the mode that sends no emails. It seems to still debar people.
20:09 atz we definitely need some kind of safe poke-around-but-don't-hurt-nobody mode.
20:09 acmoore I'd think so.
20:11 acmoore There was another documentation improvement idea that came up yesterday. I put them together in this bug http://bugs.koha.org/cgi-bin/b[…]w_bug.cgi?id=2388
20:11 acmoore I can open one up to make a test mode of some kind, too.
20:13 acmoore atz, opened 2389 for that.
20:14 atz ok, i'll leave it at that for now
20:14 atz i'll probably just hardcode the branch stuff for the client, since they are the almost the same
20:15 pianohacker (liblime or biblibre people) newbie question: how do you keep clients up to date with the latest git improvements and add their personally requested changes to just their tree?
20:17 atz pianohacker: the clients have git repos, and you just commit their changes to them
20:17 atz then when you rebase, git merges everything (or gives errors you have to sort out manually)
20:17 pianohacker OK, thanks
20:30 atz acmoore: how often should process_message_queue run?
20:34 acmoore atz, I guess maybe hourly or so? Really, it only needs to be run nightly since the only things that write to it are nightly cronjobs, but perhaps we'll have more things adding to it soon.

| Channels | #koha index | Today | Search | Google Search | Plain-Text | plain, newest first | summary