Time Nick Message 00:48 Waylon hey all. 00:51 Waylon what determines the display format of search results? 00:51 Waylon is there a xslt file involved? 00:51 Waylon or something? 00:51 * jcamins stops by while waiting for his bread to bake. 00:52 jcamins Waylon: it depends. If you have XSLT mode turned on then yes, XSLT is involved. 00:52 jcamins Otherwise, no. 00:52 Waylon okay, what is XSLT? 00:52 wahanui XSLT is a maze of twisty turny passages, all alike. 00:52 jcamins lol 00:52 Waylon no.. that sounds like zork. 00:52 jcamins XSLT is not that hard, wahanui. 00:52 wahanui ...but xslt is a maze of twisty turny passages, all alike.... 00:53 Waylon grue? 00:53 Waylon xyzzy? 00:53 jcamins eXtensible Stylesheet Language for Transformations. 00:53 Waylon xyzzy is cheating! Cheater! 00:53 Waylon xyzzy? 00:53 wahanui xyzzy is cheating! Cheater! 00:54 Waylon ah.. exactly what i want to use then. 00:55 jcamins wahanui: xslt is also http://en.wikipedia.org/wiki/XSLT and the pages at http://cs.au.dk/~amoeller/XML/transformation/ may be useful for learning the basics. 00:55 wahanui okay, jcamins. 00:55 jcamins xslt? 00:55 wahanui xslt is a maze of twisty turny passages, all alike. or http://en.wikipedia.org/wiki/XSLT and the pages at http://cs.au.dk/~amoeller/XML/transformation/ may be useful for learning the basics. 00:59 jcamins Waylon: XSLT has, generally-speaking, replaced "normal" mode. 00:59 jcamins One of the neat features for XSLT is that if the display you want is not at all suitable for inclusion upstream, you can specify your own custom XSLT. 01:00 jcamins However, if what you need is generally applicable, it's much better to get your changes upstream, so that any future improvements are available to you. 01:01 Waylon right. XSLT happens serverside, right? 01:02 jcamins Yes. 01:02 jcamins I believe it is possible to load a remote XSLT stylesheet, though, by using a fully-qualified URL. 01:03 Waylon changes i'll be making, is making the existance of a download, 856u, visible, but the actual url not there, instead, takes one to opac-download.pl?biblio=<biblio> for download tracking purposes, using C4::Log and BorrowerAttributes 01:03 Waylon which probably won't be applicable to general use? 01:04 jcamins Uhhh... 01:04 Waylon and therefore, XSLT will be the thing to use. 01:04 jcamins frankly, that sounds like a bad idea on so many levels I don't have a response. 01:04 Waylon ah? 01:04 wahanui ah is probably ? 01:05 Waylon whats wrong with it? 01:06 jcamins You are eliminating the repeatability of 856s, to start with. 01:08 Waylon ah, right. yes, so this is strictly a inhouse mod then, as for the company i work with, only one 856 per record. 01:09 jcamins Second, you're trying to use the log for analytics, which I expect is going to run into issues of database size. 01:09 jcamins (C4::Log, I mean, not logs generally) 01:09 Waylon hmm? what issues? 01:16 jcamins The size is going to explode, and it's going to be as slow as heck to get any information out of the log. 01:17 jcamins Didn't you say you had a userbase in the 10000s? 01:18 Waylon university students yeah. 01:19 jcamins Even just one hit per week from each of those is 500k entries in the log. 01:19 Waylon one account per university (for some reason i don't know, but thats the way it is) 01:19 Waylon so i think we actually only have 30 accounts.. i think.. 01:19 * Waylon shrugs. 01:19 jcamins Don't forget you can't free up space. 01:20 Waylon only by dumping and reinserting yeah. 01:20 jcamins And you get to upgrade things how often? 01:20 jcamins upgrade/maintain 01:21 * jcamins is a strong believer in trying to anticipate problems. 01:22 jcamins I think you're better off using an actual analytics package, rather than trying to use Koha's auditing functionality for crude analytics. 01:24 Waylon we are starting to use piwik, i could make the suggestion. 01:25 Waylon okay, back in 45 minutes. lunch 01:25 * jcamins leaves to eat dinner, probably won't be back. 02:38 Waylon hmmm. 02:39 Waylon took a old 3.0 biblio db.. upgraded it to master.. used the same zebra config as the old setup... reindexed. 02:39 Waylon no results. 02:40 Waylon oooo 02:40 Waylon the xsl thing. 02:41 Waylon forgot to create it. 02:48 Waylon k.. wasn't taht. 03:21 Waylon after copying over the old xslt files to new koha, reindexing. 04:34 cait good morning #koha 05:03 cait bye #koha 06:07 wajasu Waylon: i 06:07 wajasu i've got to migrate from 3.0 as well. 06:08 Waylon ... after another reindex.. still no results 06:09 wajasu when you run a rebuild_zebra -b -a -v do you see reocrds being dumped. 06:10 wajasu and are you sure the zerbasrv is started with the correct KOHA_CONF and PERL5LIB 06:17 Waylon yes and yes. 06:17 Waylon gotta go, back laters 06:17 wajasu later 06:43 cait hi #koha 08:12 jenkins_koha Starting build #173 for job Koha_3.8.x (previous build: SUCCESS) 08:46 drojf good day #koha 08:52 * cait waves again 09:14 jenkins_koha Project Koha_3.8.x build #173: SUCCESS in 1 hr 2 min: http://jenkins.koha-community.org/job/Koha_3.8.x/173/ 09:14 jenkins_koha * jcamins: Bug 8447: Make sure we have enough subfields for broader_headings 09:14 jenkins_koha * Chris Cormack: Bug 7409 : Missing dependency on libtest-mockmodule-perl 09:14 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8447 critical, P1 - high, ---, gmcharlt, Pushed to Stable , can't save new records / indicator error 09:14 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=7409 normal, P5 - low, ---, robin, Needs Signoff , Missing dependencies for Debian package 09:14 jenkins_koha Starting build #174 for job Koha_3.8.x (previous build: SUCCESS) 10:16 jenkins_koha Project Koha_3.8.x build #174: SUCCESS in 1 hr 2 min: http://jenkins.koha-community.org/job/Koha_3.8.x/174/ 10:16 jenkins_koha * colin.campbell: Bug 6976 Close loophole allowing borrowers extra holds via opac 10:16 jenkins_koha * jonathan.druart: Bug 8002: FIX Change datatype from varchar 1 to 10 for borrower_attribute_types.category_code 10:16 jenkins_koha * Chris Cormack: Bug 8002 : Database bump 10:16 jenkins_koha * jcamins: Bug 8743: ZOOM error when merging authority change to biblios 10:16 jenkins_koha * Paul Poulain: Bug 8743 follow-up, throw a more explanatory error message 10:16 jenkins_koha * colin.campbell: Bug 8653 remove erroneous whitespace blocking indexing 10:16 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=6976 major, P1 - high, ---, colin.campbell, Pushed to Stable , User hold limit can be avoided by users in OPAC 10:16 jenkins_koha * tomascohen: Bug 8520 - Authorities summary incorrect on posible duplicate notice 10:16 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8002 critical, P2, ---, oleonard, Pushed to Stable , Can't add patron attribute type in newer installation 10:16 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8743 critical, P3, ---, jcamins, Pushed to Stable , ZOOM error when merging authority change to biblios 10:16 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8653 normal, P4, ---, colin.campbell, Pushed to Stable , With DOM indexing turned on subject authority links are not indexed 10:16 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8520 critical, P5 - low, ---, jcamins, Pushed to Stable , Authorities display incorrectly in staff results 10:16 jenkins_koha Starting build #175 for job Koha_3.8.x (previous build: SUCCESS) 10:22 Waylon hiya all! 10:43 Waylon took a old 3.0 biblio db.. upgraded it to master.. used the same zebra config as the old setup... reindexed, got no results. help? 10:48 mtj did you follow the upgrade notes in INSTALL.debian ? 10:49 mtj and run this script? -> misc/maintenance/remove_items_from_biblioitems.pl --run 10:50 Waylon yes, i did. 10:50 Waylon and also ran updatedatabase too, since it found it needed doing. 10:50 mtj have you checked all the obvious stuff? 10:51 Waylon whats obvious? 10:52 mtj run zebra_rebuild -r -b -x - v , and got no errors 10:52 mtj and got a sane count of bibs processes, on completion 10:52 Waylon did zebra_rebuild -r -b -a -v -v 10:52 Waylon why -x? 10:53 mtj did it complete ok? or barf? 10:53 Waylon said it completed okay. 10:53 mtj do yu have a stable koha to compare against? 10:53 Waylon [log] Records: 196893 i/u/d 196893/0/0 10:54 mtj that looks good 10:54 Waylon hmm? only the koha currently in production. 10:54 Waylon thats 3.0 10:55 Waylon [log] Iterations: isam/dict 291501887/3024638 10:55 mtj my advice…. sort a stable koha to compare against 10:55 Waylon [log] Dict: inserts/updates/deletions: 3024638/0/0 10:56 mtj if you get different outputs to your stable koha, you've got a debuggable problem 10:58 mtj so, is your zeb-rebuild behaving similar to your stable koha 10:58 mtj is your zebrasrv behaving similar to your stable koha 10:59 mtj if no, you've got a debuggable problem - if yes, you've got a trickier problem :/ 10:59 Waylon turned on debug level logging in koha-zebra.. 11:00 Waylon huh.. new Zebra doesn't give the query used? 11:00 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Got PDU, 119 bytes: lead=B4 75 83 11:00 Waylon 05:56:56-16/09 zebrasrv(1) [debug] server select: config=/usr/local/apps/koha/kohadev-etc/etc/zebradb/zebra-biblios.cfg 11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] bend_init 11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] zebra_open zs=0x1250570 returns 0x1250e20 11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Sort handler installed 11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Search handler installed 11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] ESRequest handler installed 11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Delete handler installed 11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Scan handler installed 11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Segment handler installed 11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] result immediately available 11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] ir_session (output) 11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Wrote PDU, 183 bytes 11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] zebra_close zh=0x1250e20 11:02 Waylon thats all there is. 11:02 mtj http://paste.koha-community.org/ 11:02 Waylon hm. right.. ah.. too late 11:03 mtj so, what happens if you do a search? 11:03 Waylon that is from a search 11:04 Waylon from a intranet search 11:05 Waylon mandumah.com, working server, is zebra 2.0.43, the new server in devel, is zebra 2.0.52 11:05 Waylon hmmmmmmm.. 11:05 mtj hmm, perhaps use the new zebra conf files, much has changed since 3.0 11:05 Waylon right, but that would take out all the customization that mandumah did. 11:06 mtj do a diff, lots of changes yeah? 11:06 mtj yep, you would lose those mods :/ but at least you might have a working search… to start with 11:07 Waylon maybe.. okay.. ill swap the configs. 11:07 mtj make sense, yeah 11:08 mtj use git on your zebra files 11:08 Waylon on its way. 11:08 mtj start fresh and functioning, then add your mod... 11:08 mtj when it breaks, your last added mod was the problem 11:09 Waylon if this works, guess i will have to manually go through the marc setup. 11:18 jenkins_koha Project Koha_3.8.x build #175: SUCCESS in 1 hr 1 min: http://jenkins.koha-community.org/job/Koha_3.8.x/175/ 11:18 jenkins_koha Chris Cormack: Bug 7409 : Fixing typo 11:18 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=7409 normal, P5 - low, ---, robin, Needs Signoff , Missing dependencies for Debian package 11:18 jenkins_koha Starting build #176 for job Koha_3.8.x (previous build: SUCCESS) 11:19 mtj hmm, usually no - but if youve heavily tweaked your zebra files and marc framework, …then perhaps? 12:00 Waylon mtj, koha master config, fails. 12:00 Waylon still no results 12:06 jcamins_away Sounds like you adjusted your Zebra configuration in a non-compatible way. 12:08 Waylon hrm. 12:08 jcamins_away Actually, looking at the output you pasted into the channel, sounds like Zebra isn't running. 12:08 Waylon i mean, koha master zebra config fails. 12:08 Waylon ah? zebra is running. 12:10 jcamins_away This bread is amazing. 12:10 Waylon huh? 12:11 jcamins_away In that case, I think I'm back to theory A: you made non-compatible changes to your Zebra config and are storing necessary data in strange places. 12:14 lodac Morning 12:15 lodac I work in the education sector (k-12). Any recommendation of some American based companies that would provide support to a koha user for a district? 12:15 lodac paid of-course 12:16 jcamins_away support? 12:16 wahanui support is probably found at http://koha-community.org/support/ 12:16 jcamins_away paid support? 12:16 wahanui please see http://koha-community.org/support/paid-support/ for a list of paid Koha support vendors. 12:16 jcamins_away ^^ there is a list, though not everyone is on it (I'm not, for example) 12:17 lodac I notice that list for US is 247 days old... so that is why I asked here 12:17 jcamins_away That list is kept up to date. 12:17 lodac jcamins_away: are you looking for customers? 12:17 jcamins_away lodac: responding off-channel 12:20 jenkins_koha Project Koha_3.8.x build #176: SUCCESS in 1 hr 1 min: http://jenkins.koha-community.org/job/Koha_3.8.x/176/ 12:27 Waylon any way to examine the contents of the zebradb? 12:27 Waylon without asking a specific query? 12:29 jcamins_away Waylon: not easily, no. 12:31 Waylon ooo. 12:31 Waylon got it working 12:31 Waylon in -v all 12:31 Waylon mode. 12:32 Waylon hmmmmm.. 12:35 Waylon okay, yay. hmm 12:41 jcamins_away Waylon: what was the problem? 12:42 Waylon not sure. running it again with the old zebra config. 12:42 Waylon and reindexing 12:42 wajasu maybe you might want to look into the yaz-client? 12:43 jcamins_away ^^ good ides 12:43 jcamins_away *idea 12:43 jcamins_away yaz? 12:43 wahanui rumour has it yaz is from IndexData and the Koha XSLT filters are essentially copied from YAZ 12:43 jcamins_away yaz client? 12:43 jcamins_away troubleshooting with yaz client? 12:44 wajasu man yaz and man yaz-client will help 12:45 jcamins_away understanding zebra indexing? 12:45 jcamins_away understanding zebra indexing is http://wiki.koha-community.org/wiki/Understanding_Zebra_indexing 12:45 jcamins_away yaz client is http://wiki.koha-community.org/wiki/Understanding_Zebra_indexing 13:30 jcamins_away mtj: 8210 is rebased 14:10 Waylon zebra? 14:10 wahanui it has been said that zebra is a fielded free text indexing and retrieval engine with a Z39.50 front-end. You can use any compatible, commercial, or freeware Z39.50 client to access data stored in Zebra. or the search engine koha uses 14:11 Waylon zebra troubleshooting is see [understanding zebra indexing] and [yaz client] 14:11 Waylon zebra troubleshooting? 14:11 wahanui well, zebra troubleshooting is see [understanding zebra indexing] and [yaz client] 14:11 Waylon okay, bed time. 14:11 Waylon laters all 15:23 tcohen hi #koha 15:24 tcohen mtj, have you seen bug 8773? 15:24 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8773 enhancement, P5 - low, ---, tomascohen, Needs Signoff , Add per-instance koha-index-daemon in .deb setup 17:56 * cait waves 18:47 cait hi drojf :) 19:27 rangi @wunder nzwn 19:27 huginn rangi: The current temperature in Wellington, New Zealand is 12.0°C (7:20 AM NZST on September 17, 2012). Conditions: Rain Showers. Humidity: 94%. Dew Point: 11.0°C. Pressure: 29.65 in 1004 hPa (Steady). 19:28 cait ew 19:28 cait @wunder Konstanz 19:28 huginn cait: The current temperature in Taegerwilen, Taegerwilen, Germany is 12.8°C (9:25 PM CEST on September 16, 2012). Conditions: Clear. Humidity: 88%. Dew Point: 11.0°C. Pressure: 29.98 in 1015 hPa (Steady). 19:32 wajasu i played with DBIx last night. I used the DBIx::Class::Schema::Loader to completely generate DBIx classes for our schema. wrote some simple queries using the objects. 19:33 rangi Yep there's a branch with that all done 19:33 rangi The schema is all that interests me 19:33 wajasu now i a thinking of using them to help write tests. 19:33 rangi Specially ::versioned 19:34 wajasu do you want to use the db schema migration stuff? 19:34 rangi Hmm I wouldn't ... You wouldn't be testing the actual queries if you did that 19:35 rangi But yes instead of updatedatabase.pl and the .sql 19:35 rangi Use versioned schema 19:37 wajasu plus it has that DateTime component. it would be nice to have time/durections normalized so folks writing scheduling/calender sensitive stuff would have an easier time. 19:38 wajasu durections/durations 19:39 wajasu i was thinking if someone wrote a OO domain model, that used the DBIx underneath, we could write tests for all the DB layer and the OO domain and services. before the implementation 19:41 wajasu we could assign bugs to folks to code/wire up the implementations, and uncomment the tests as part of the bugs. then we could get the tests written. 19:41 rangi Yep but in the mean time (next 3 feature releases at least) we need to go from 56 to close to 100 19:41 rangi Coverage 19:42 rangi Before we start a major rewrite 19:42 rangi Or we will break tons more than we fix 19:42 cait good point 19:42 rangi Rewrites are fun 19:43 rangi But gotta do the hard work first 19:43 wajasu ok. so that is the plan. i'm with you. so as i get more familiar with the codebase, i should just write tests so we don't fall behind. 19:43 rangi That would be awesome 19:46 wajasu for consistency sake, i would like a nice new OO domain model in there. I wish I could test against that with the implementation calling our current stuff. then let people rewrite the implementations, while keeping the tests passing. 19:47 rangi OO isn't a panacea and shouldn't be thrown at everything 19:48 rangi Especially structures that you have to coerce into being an object 19:48 wajasu true. but encapsulation is the goal. composition... 19:48 rangi But I mostly agree with u 19:48 rangi Goal is a fast system for end users 19:49 rangi Everything else is a means to that 19:50 wajasu thats why i want to set up a stack with and without layers (with erformance/profiler, etc). 19:50 rangi Fast and stable 19:52 wajasu i did a reverse engineer of the db a coupld of months ago in java/hibernate, and there a number of schema issues (nullable keys, etc). when i did the same with DBIx, those issue are still there. 19:52 wajasu so as the architects discover them, i guess they can write a bug and baby step the schema to where is need to be. 19:52 rangi Fixing kohastructure.sql would be the first step then 19:55 rangi My stop bbiab 20:19 wajasu http://wiki.koha-community.org/wiki/Coding_Guidelines has a link under (PERL13) POD that is broken these days. 20:25 jcamins_away rangi: I think I have to call BS on rewrites being fun. 20:26 jcamins_away Rewrites suck, and make me grouchy. 20:26 rangi people should stop doing them then 20:26 rangi or at least stop making them the first thing they do, rather than the last 20:26 rangi cos every rewrite of a major feature in koha, to this point 20:27 rangi has been a huge pita for the next at least 6 months 20:27 jcamins_away This is true. Unfortunately, C4::Search is still sitting there, mocking our attempts to make any arbitrary input from the user work. 20:28 cait jcamins_away: but you started with writing tests for it :) 20:28 * cait is optimistic 20:28 * magnuse too 20:28 jcamins_away cait: I did. 20:28 jcamins_away And it's a damn fine test, if I say so myself. 20:29 magnuse hehe 20:29 cait :) 20:29 cait hi magnuse :) 20:29 wajasu i also wish there was separate "test" dependencies. 20:29 magnuse hiya cait 20:30 wajasu if say i want to use Test::Spec for BDD and write 50 tests. i wouldn't want that to affect production deps. 20:30 jcamins_away wajasu: add it as optional. 20:30 wajasu ahh 20:30 jcamins_away I don't see any problem with that. 20:30 rangi and make it not in t/ 20:30 rangi but lower 20:31 rangi because if it is in t/ 20:31 jcamins Right. 20:31 rangi its not optional it is mandatory 20:31 wajasu gotch. like db_dependent 20:32 rangi yep 20:33 jcamins Or t/bdd/ 20:34 wajasu getting back to the DBIx test idea. i want to use th DBIx::Class::Schema::Loader to generate OO code that is independent from the DB (myslq/postgres), then call our code, but use the DBIx classes to inspect the results. so when we rewrite, only the current calls have to be coded in the given: when: then scenarios. 20:35 jcamins wajasu: if that technique can test functionality *now* it sounds like a fine idea. 20:35 wajasu and the tests are more db independent 20:36 wajasu i'll try it out on something simple, then something complex and you let me know if its good to go. 20:36 jcamins wajasu: as long as the tests give meaningful results, I will support the inclusion in Koha. 20:39 wajasu ok. 20:42 wajasu oh. by the way tried that XML::Easy and replaced XML::Simple. Did the load_testing/benchmark_staff.pl and got the same results. 20:44 wajasu i did notice: the zebra config sections have XIncludes and go grab those files and parse them as well. (XML::Simple does I assume), not that it makes a difference. 20:45 jcamins wajasu: actually, the Zebra config sections are not used, I think. 20:46 jcamins marcelr just reported that. 20:46 wajasu i wonder if creation of a new db connection is the issue, or if the fact that many places don't dbh->disconnect, causes mysql to "timeout" before cleanup. 20:46 jcamins wajasu: huh? 20:47 jcamins the first question? 20:47 wahanui "What are you trying to do?" "What is the goal?" or "What problem are you experiencing?" 20:49 wajasu i was in C4, and grepped for dbh->disconnect. I read that CGI supposedly cleans up? but i also read on a site that if we don't cleanup the resource at the end of scripts, the database may have to "timeout". so since i was running the apachebench benchmark, i wonder. 20:49 jcamins wajasu: so what is the problem you've encountered? 20:50 wajasu i'm wondering why/how that bug wants to get more performance. 20:50 wajasu the removal of XML::Simple. I understand about memcache probably taking care of it. 20:51 jcamins What bug? XML parsing has nothing to do with connecting to MySQL. 20:52 wajasu bug 7170. 20:52 wahanui bug 7170 is what I was looking at 20:52 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=7170 normal, P3, ---, paul.poulain, REOPENED , Remove use of XML::Simple 20:52 jcamins Right, that has nothing to do with MySQL. 20:52 jcamins That is about how long it takes to parse koha-conf.xml. 20:53 wajasu i left the XML::Simple in, and added the parsing with XML::Easy and the benchmark ran with the same time. 20:54 jcamins Right, it's not an important bug. 20:58 wajasu i was trying to understand if there was a perfomance issue setting up Context.pm "too many queries, plus perl startup, plus db connection(no connection pool). And if that was the driving force to plackify. If so, we should code a plackified context and benchmark. 20:59 jcamins C4::Context is not very efficient, but the bigger issue is the overall load time. 21:00 jcamins The difference between 22ms and 20ms just isn't that big a deal when you're talking about a total load time of 400ms+. 21:02 jcamins If you want to see what I'm talking about, run the following command: perl -MDevel::NYTProf -e "use C4::Search; use C4::Circulation; print 'Hello, world!';" 21:02 jcamins Then take a look at the results. 21:02 jcamins Obviously the faster your computer the less dramatic it will be. 21:03 wajasu ok. i will. 21:03 wajasu you mean the load time for perl. right? 21:04 jcamins Load time for Koha's modules. 21:04 wajasu ahh. 21:04 jcamins I think I rembered the correct modules for the most dramatic effect. 21:04 jcamins *remembered 21:05 jcamins ^^ not me 21:06 rangi heh 21:06 Jared Hello, I'm looking for information on Koha - Zebra permissions. I'm installing on Fedora and am getting "Search biblios ERROR 109" from zebrasrv. 21:08 jcamins Jared: have you reindexed yet? 21:08 Jared files in "/var/lock/koha/zebradb/" are owned by the system user "koha". Is this the same user as what is in /etc/koha/zebradb/zebra-biblios.cfg? 21:10 Jared Have I reindexed? I think so. I have run "/usr/share/koha/bin/migration_tools/rebuild_zebra.pl -v -v -b -a" I can send the output if that is helpful. 21:10 jcamins Jared: no. Zebra user and system user are unrelated. 21:10 Jared This is a new install...not an upgrade. I did put one card/item in the catalog. 21:11 jcamins Jared: stick the output in paste.koha-community.org. 21:11 jcamins Full disclosure: I dislike non-Debian systems because they don't play nicely with Koha. 21:12 pastebot "Jared" at 127.0.0.1 pasted "rebuild script output" (29 lines) at http://paste.koha-community.org/175 21:12 jcamins Umm, add another -v. 21:13 Jared jcamins, can you describe how the permissions work? HTTPd runs as user "apache"...that then calls out to zebrasrv. zebrasrv (somehow) connects to actual files on the filesystem. 21:13 Jared I added another -v, output is the same. I can re-paste 21:13 jcamins No need. 21:14 jcamins See above about my hatred of non-Debian systems. ;) 21:14 jcamins zebrasrv is running as your koha user. 21:14 Jared Is there any concern about using a version of zebra that is too new? 21:14 jcamins The CGI script connects via socket. 21:14 jcamins No. 21:14 Jared yes, zebrasrv is being run after "su koha -" 21:16 jcamins You must run rebuild_zebra as that same user. 21:16 jcamins All Zebra files must be owned by that user. 21:17 jcamins However, 109 isn't a permissions error, I don't think... that sounds like a "Zebra isn't being run with the correct configuration" error to me. 21:17 Jared I did run rebuild_zebra as that user. 21:17 Jared as far as I can tell, everything under /var/*/koha is owned by koha.koha 21:18 jcamins Yeah, so I think the problem you're running into is that Zebra is failing to use your configuration file. 21:18 jcamins Wait, how are you starting Zebra? 21:19 Jared how am I starting zebrasrv? For now just on the command-line: "/usr/local/bin/zebrasrv -v all -f /etc/koha/koha-conf.xml" 21:19 * jcamins adds for the benefit of those just joining it that "Jared" is not me. 21:19 jcamins Paste that into paste.koha-community.org? 21:20 jcamins *in 21:20 Jared I can paste the output of ls -l on /var/*/koha...but all of the permissions look ok 21:20 Jared I'll paste the zebrasrv output first. 21:20 jcamins No, nothing to do with permissions. 21:20 jcamins You should be getting a ton of output from zebrasrv. 21:21 pastebot "Jared" at 127.0.0.1 pasted "zebrasrv output showing error 109 (Fedora)" (109 lines) at http://paste.koha-community.org/176 21:22 Jared Is debian the only "officially" supported OS distro for koha? 21:22 jcamins Jared: I don't know about "official," but certainly you'll get a lot more help with Debian/Ubuntu. 21:23 jcamins Jared: try using yaz client directly. 21:23 jcamins yaz client? 21:23 wahanui yaz client is http://wiki.koha-community.org/wiki/Understanding_Zebra_indexing 21:24 Jared same error if I use Yaz client. I can do it again, but previously, I got identical stuff in the zebrasrv log 21:24 jcamins I want to know what it says *before* you do the search. 21:24 jcamins When you connect to the server and set the database. 21:26 Jared from the yaz-client? 21:26 jcamins Right. 21:27 wajasu http://koha.1045719.n5.nabble.com/Weird-search-problem-td3072111.html 21:27 jcamins It should give you some sort of diagnostics, as I recall. 21:28 Jared there is some extra info, but it appears (to me) to connect to zebrasrv ok 21:28 jcamins Jared: hm, nothing about unrecognized option? 21:30 Jared I did paste the yaz-client output...but didn't see the paste link. I'll paste it again. 21:31 pastebot "Jared" at 127.0.0.1 pasted "yaz-client output" (24 lines) at http://paste.koha-community.org/178 21:35 jcamins Jared: try doing the database init thing. 21:35 jcamins You won't get any results, but you might not get the error after it's done. 21:35 jcamins faq? 21:35 wahanui well, faq is found at http://koha-community.org/documentation/faq/ 21:35 Jared database init is the reindex_zebra script? 21:36 jcamins No. 21:36 jcamins At the end of that file it has a suggestion of resetting your Zebra indexes. 21:36 jcamins Under "I have double ups..." 21:36 jcamins Oh, the init was removed. 21:37 Jared can you clarify "the database init thing" Are you referring to "koha-rebuild-zebra"? 21:38 jcamins So, run that drop command, then do: zebraidx -c /path/to/zebra-biblios.cfg -d biblios init 21:38 jcamins I am telling you what to do. 21:38 jcamins Then do the commit. 21:38 Jared ok. Do this as the koha user, I assume 21:38 jcamins Yes. 21:39 jcamins What version of Koha are you using? 21:39 jcamins I should have asked this first. 21:43 pastebot "Jared" at 127.0.0.1 pasted "biblios rebuild" (48 lines) at http://paste.koha-community.org/179 21:43 jcamins Ah-ha. 21:43 jcamins This is helpful. 21:43 jcamins Let me figure out what it helped us find out. 21:44 Jared interestingly, it says there was no biblios db when dropping it. 21:44 Jared I have installed Koha koha-3.08.04 21:44 rangi id do the create before rebuild_zebra see if that fixes it 21:45 wajasu database unavailable: the user/pass OR the perms usually. following the KOHA_CONF to the koha-conf.xml /var/lib/koha/... make sure the user you run zebrasrv as has perms to read/write all the way down that heirarchy. 21:47 jcamins wajasu: this isn't the standard no permissions error, though, I don't think. 21:48 jcamins Jared: share ls -l /var/lib/koha? 21:48 Jared wajasu: Yes, everything under /var/lib/koha is koha.koha 21:48 jcamins ls -lR 21:48 pastebot "Jared" at 127.0.0.1 pasted "/var/lib/koha permissions" (65 lines) at http://paste.koha-community.org/180 21:50 jcamins Interesting way of doing ls -lR. :) 21:52 pastebot "jcamins" at 127.0.0.1 pasted "Jared (not me): try this" (2 lines) at http://paste.koha-community.org/181 21:53 jcamins Jared: as you probably gathered, my name is also Jared, and it's kind of throwing me. ;) 21:54 pastebot "Jared" at 127.0.0.1 pasted "Output of zebraidx commands. zebrasrv still returns error 109" (52 lines) at http://paste.koha-community.org/182 21:55 Jared It's good to know there's another Jared out there. There aren't too many 21:56 jcamins When I was younger, I had a class with another Jared. 21:58 jcamins I have no idea what's going on there. 21:59 Jared So, I'm trying to recap. You had be run 4 zebraidx commands in an attempt to rebuild zebra-biblios and zebra-biblios-cfg 21:59 Jared sorry, zebra-biblios and zebra-biblios-dom 21:59 jcamins The first set was incorrect. 21:59 jcamins I caught that after the fact. 22:00 jcamins It should have been zebra-biblios-dom all along. 22:00 Jared Some more context for you, I have fedora, have installed all of the perl modules (via cpan) 22:00 Jared I have yaz-3.0.49-1.fc13.x86_64 instaled as an RPM via yum 22:01 Jared I have idzebra-2.0.52 installed via a tarball 22:02 Jared and I have koha 3.08.04 installed. When installing, I accepted all of the defaults from Makefile.PL 22:02 jcamins Oh, I bet I know what it is. 22:02 Jared I did run the install twice (make uninstall and re-ran gunzip & tar) Same effect both times. 22:03 jcamins Did you open up the zebra-biblios-dom.cfg file and make sure that all the paths listed match where your files ended up? 22:03 jcamins In particular, I think there's a modulePath directive that is likely to be wrong. 22:05 Jared yes that path is wrong 22:06 jcamins Well, it took a while, but I knew we'd find it eventually. :) 22:09 Jared still getting error 109 22:09 jcamins Well, yes, that wasn't what was causing the problem. 22:10 Jared sorry, I'm on the phone for a few minutes.... Appreciate your ideas. The module path was definitely wrong 22:17 Jared Hi, sorry about that. 22:18 jcamins We need a "select all" button in the webinstaller. 22:18 Jared Do I need to drop and rebuild the databases and rerun the rebuild_zebra script? 22:18 jcamins Or to make the test clickable. 22:19 jcamins Yeah, repeat the init thing. 22:19 Jared ok, will do 22:19 Jared do authorites-dom and biblios-dom or all 4? 22:20 jcamins zebra-biblios-dom 22:20 jcamins The init and commit commands. 22:21 jcamins Hey, the password field on master is an actual password box. 22:21 jcamins Nice! 22:22 rangi 3.8.x too 22:23 jcamins Oh, I haven't created any new users in my 3.8.x installs. 22:24 pastebot "Jared" at 127.0.0.1 pasted "Rebuild steps" (3 lines) at http://paste.koha-community.org/183 22:24 Jared hmm, so despite the changes, I still get error 109. 22:25 jcamins And you got no output? 22:25 Jared one other thing I did notice, is that by default, stuff is installed to /usr/local/bin, which is not in the default path on fedora. 22:25 jcamins Also, try just those first two lines. 22:34 Jared I think the takeaway is that this zebra stuff just doesn't work on fedora/centos/rhel. I'd encourage you to document this somewhere 22:34 Jared I'll have to setup a debian install and test it again there. 22:35 jcamins Jared: I think we've documented it repeatedly. 22:35 jcamins And it's not that it can't be made to work. 22:35 Jared then my apologies, I missed it. What is the best supported distro...latest debian? 22:35 jcamins One developer uses Fedora. 22:36 jcamins Jared: no, that was documented, past tense. I don't think it's so much that you missed it as the "use Debian" recommendation was replaced with "here's how I got an old version of Koha to almost run on Fedora." 22:36 jcamins Yeah, Squeeze is the way to go. 22:36 jcamins packages? 22:36 wahanui packages is, like, at http://wiki.koha-community.org/wiki/Debian 22:36 jcamins ^^ follow that guide. 22:36 jcamins It's dead simple. 22:49 wajasu http://www.loc.gov/z3950/agency/defns/bib1diag.html 22:50 wajasu i always have to run zebra as root. 22:50 jcamins wajasu: then you have your system set up wrong. 22:50 jcamins If you're satisfied with that, though, I suggest you just leave it. 22:50 wajasu i could not infer it fromthe INSTALL instructions. 4 years ago. 22:50 wajasu the problem was apache was so different from debian 22:51 wajasu none of the same command line tools that apache has. but i was on archlinux. 22:52 wajasu i'm about to upgrade to 3.10 once that's released. 22:53 wajasu and run debian in a VM. 22:55 wajasu it would take 4hours to assemble dependencies from cpan, and build archlinux packages. perl didn't have but a couple of koha's deps. so i saw the light. debian. 23:45 wajasu jcamins: that nyt report is great. thx 23:45 jcamins wajasu: you're welcome. Kind of extraordinary, isn't it, how long it takes for Koha modules to load? 23:46 wajasu yup. 23:50 wajasu i got 1.29secs total with koha running in a VM with /home/koha/kohadev in the VM filesystem and /home/koha/kohaclone sshfs mounted to my hostOS. 23:51 jcamins Heck of a lot faster than on my laptop. 23:51 jcamins 2.57s. 23:52 wajasu so the more deps the slower. but if they plackify, they are preloaded, and only what is needed is run in on plackified scripts. right ? 23:53 jcamins Right. 23:53 jcamins The BEGIN blocks are run exactly once under Plack. 23:57 wajasu i am really glad you are getting search up to par. i hope with your future search plugins, you make a composable plugin, where one can stack them, and configure it so that (a) if no results, run the second, (b) run in parallel with immediate results from one, and asynchronous ajaxified rsults arriving right behind. 23:58 wajasu but i know there is alot of work to do before that. 23:58 jcamins I am designing the system so it would be possible to do that. 23:59 wajasu i could tell.