IRC log for #koha, 2012-09-16

All times shown according to UTC.

Time S Nick Message
00:48 Waylon joined #koha
00:48 Waylon hey all.
00:51 Waylon what determines the display format of search results?
00:51 Waylon is there a xslt file involved?
00:51 Waylon or something?
00:51 * jcamins stops by while waiting for his bread to bake.
00:52 jcamins Waylon: it depends. If you have XSLT mode turned on then yes, XSLT is involved.
00:52 jcamins Otherwise, no.
00:52 Waylon okay, what is XSLT?
00:52 wahanui XSLT is a maze of twisty turny passages, all alike.
00:52 jcamins lol
00:52 Waylon no.. that sounds like zork.
00:52 jcamins XSLT is not that hard, wahanui.
00:52 wahanui ...but xslt is a maze of twisty turny passages, all alike....
00:53 Waylon grue?
00:53 Waylon xyzzy?
00:53 jcamins eXtensible Stylesheet Language for Transformations.
00:53 Waylon xyzzy is cheating! Cheater!
00:53 Waylon xyzzy?
00:53 wahanui xyzzy is cheating! Cheater!
00:54 Waylon ah.. exactly what i want to use then.
00:55 jcamins wahanui: xslt is also http://en.wikipedia.org/wiki/XSLT and the pages at http://cs.au.dk/~amoeller/XML/transformation/ may be useful for learning the basics.
00:55 wahanui okay, jcamins.
00:55 jcamins xslt?
00:55 wahanui xslt is a maze of twisty turny passages, all alike. or http://en.wikipedia.org/wiki/XSLT and the pages at http://cs.au.dk/~amoeller/XML/transformation/ may be useful for learning the basics.
00:59 jcamins Waylon: XSLT has, generally-speaking, replaced "normal" mode.
00:59 jcamins One of the neat features for XSLT is that if the display you want is not at all suitable for inclusion upstream, you can specify your own custom XSLT.
01:00 jcamins However, if what you need is generally applicable, it's much better to get your changes upstream, so that any future improvements are available to you.
01:01 Waylon right. XSLT happens serverside, right?
01:02 jcamins Yes.
01:02 jcamins I believe it is possible to load a remote XSLT stylesheet, though, by using a fully-qualified URL.
01:03 Waylon changes i'll be making, is making the existance of a download, 856u, visible, but the actual url not there, instead, takes one to opac-download.pl?biblio=<biblio> for download tracking purposes, using C4::Log and BorrowerAttributes
01:03 Waylon which probably won't be applicable to general use?
01:04 jcamins Uhhh...
01:04 Waylon and therefore, XSLT will be the thing to use.
01:04 jcamins frankly, that sounds like a bad idea on so many levels I don't have a response.
01:04 Waylon ah?
01:04 wahanui ah is probably ?
01:05 Waylon whats wrong with it?
01:06 jcamins You are eliminating the repeatability of 856s, to start with.
01:08 Waylon ah, right. yes, so this is strictly a inhouse mod then, as for the company i work with, only one 856 per record.
01:09 jcamins Second, you're trying to use the log for analytics, which I expect is going to run into issues of database size.
01:09 jcamins (C4::Log, I mean, not logs generally)
01:09 Waylon hmm? what issues?
01:16 jcamins The size is going to explode, and it's going to be as slow as heck to get any information out of the log.
01:17 jcamins Didn't you say you had a userbase in the 10000s?
01:18 Waylon university students yeah.
01:19 jcamins Even just one hit per week from each of those is 500k entries in the log.
01:19 Waylon one account per university (for some reason i don't know, but thats the way it is)
01:19 Waylon so i think we actually only have 30 accounts.. i think..
01:19 * Waylon shrugs.
01:19 jcamins Don't forget you can't free up space.
01:20 Waylon only by dumping and reinserting yeah.
01:20 jcamins And you get to upgrade things how often?
01:20 jcamins upgrade/maintain
01:21 * jcamins is a strong believer in trying to anticipate problems.
01:22 jcamins I think you're better off using an actual analytics package, rather than trying to use Koha's auditing functionality for crude analytics.
01:24 Waylon we are starting to use piwik, i could make the suggestion.
01:25 Waylon okay, back in 45 minutes. lunch
01:25 * jcamins leaves to eat dinner, probably won't be back.
01:51 tater joined #koha
02:38 Waylon hmmm.
02:39 Waylon took a old 3.0 biblio db.. upgraded it to master.. used the same zebra config as the old setup... reindexed.
02:39 Waylon no results.
02:40 Waylon oooo
02:40 Waylon the xsl thing.
02:41 Waylon forgot to create it.
02:48 Waylon k.. wasn't taht.
03:21 Waylon after copying over the old xslt files to new koha, reindexing.
04:34 cait joined #koha
04:34 cait good morning #koha
05:03 cait bye #koha
06:07 wajasu Waylon: i
06:07 wajasu i've got to migrate from 3.0 as well.
06:08 Waylon ... after another reindex.. still no results
06:09 wajasu when you run a rebuild_zebra -b -a -v      do you see reocrds being dumped.
06:10 wajasu and are you sure the zerbasrv is started with the correct KOHA_CONF and PERL5LIB
06:17 Waylon yes and yes.
06:17 Waylon gotta go, back laters
06:17 wajasu later
06:42 cait joined #koha
06:43 cait hi #koha
06:47 mbalmer joined #koha
06:51 cait1 joined #koha
06:59 cait joined #koha
08:11 cait joined #koha
08:12 jenkins_koha Starting build #173 for job Koha_3.8.x (previous build: SUCCESS)
08:46 drojf good day #koha
08:47 drojf left #koha
08:50 cait joined #koha
08:52 * cait waves again
08:55 drojf joined #koha
09:06 cait joined #koha
09:14 jenkins_koha Project Koha_3.8.x build #173: SUCCESS in 1 hr 2 min: http://jenkins.koha-community.[…]b/Koha_3.8.x/173/
09:14 jenkins_koha * jcamins: Bug 8447: Make sure we have enough subfields for broader_headings
09:14 jenkins_koha * Chris Cormack: Bug 7409 : Missing dependency on libtest-mockmodule-perl
09:14 huginn Bug http://bugs.koha-community.org[…]w_bug.cgi?id=8447 critical, P1 - high, ---, gmcharlt, Pushed to Stable , can't save new records / indicator error
09:14 huginn Bug http://bugs.koha-community.org[…]w_bug.cgi?id=7409 normal, P5 - low, ---, robin, Needs Signoff , Missing dependencies for Debian package
09:14 jenkins_koha Starting build #174 for job Koha_3.8.x (previous build: SUCCESS)
09:36 drojf1 joined #koha
09:49 cait joined #koha
10:02 cait left #koha
10:16 jenkins_koha Project Koha_3.8.x build #174: SUCCESS in 1 hr 2 min: http://jenkins.koha-community.[…]b/Koha_3.8.x/174/
10:16 jenkins_koha * colin.campbell: Bug 6976 Close loophole allowing borrowers extra holds via opac
10:16 jenkins_koha * jonathan.druart: Bug 8002: FIX Change datatype from varchar 1 to 10 for borrower_attribute_types.category_code
10:16 jenkins_koha * Chris Cormack: Bug 8002 : Database bump
10:16 jenkins_koha * jcamins: Bug 8743: ZOOM error when merging authority change to biblios
10:16 jenkins_koha * Paul Poulain: Bug 8743 follow-up, throw a more explanatory error message
10:16 jenkins_koha * colin.campbell: Bug 8653 remove erroneous whitespace blocking indexing
10:16 huginn Bug http://bugs.koha-community.org[…]w_bug.cgi?id=6976 major, P1 - high, ---, colin.campbell, Pushed to Stable , User hold limit can be avoided by users in OPAC
10:16 jenkins_koha * tomascohen: Bug 8520 - Authorities summary incorrect on posible duplicate notice
10:16 huginn Bug http://bugs.koha-community.org[…]w_bug.cgi?id=8002 critical, P2, ---, oleonard, Pushed to Stable , Can't add patron attribute type in newer installation
10:16 huginn Bug http://bugs.koha-community.org[…]w_bug.cgi?id=8743 critical, P3, ---, jcamins, Pushed to Stable , ZOOM error when merging authority change to biblios
10:16 huginn Bug http://bugs.koha-community.org[…]w_bug.cgi?id=8653 normal, P4, ---, colin.campbell, Pushed to Stable , With DOM indexing turned on subject authority links are not indexed
10:16 huginn Bug http://bugs.koha-community.org[…]w_bug.cgi?id=8520 critical, P5 - low, ---, jcamins, Pushed to Stable , Authorities display incorrectly in staff results
10:16 jenkins_koha Starting build #175 for job Koha_3.8.x (previous build: SUCCESS)
10:22 Waylon joined #koha
10:22 Waylon hiya all!
10:43 Waylon took a old 3.0 biblio db.. upgraded it to master.. used the same zebra config as the old setup... reindexed, got no results. help?
10:48 mtj did you follow the upgrade notes in INSTALL.debian ?
10:49 mtj and run this script? ->  misc/maintenance/remove_items_from_biblioitems.pl --run
10:50 Waylon yes, i did.
10:50 Waylon and also ran updatedatabase too, since it found it needed doing.
10:50 mtj have you checked all the obvious stuff?
10:51 Waylon whats obvious?
10:52 mtj run zebra_rebuild -r -b -x - v , and got no errors
10:52 mtj and got a sane count of bibs processes, on completion
10:52 Waylon did zebra_rebuild -r -b -a -v -v
10:52 Waylon why -x?
10:53 mtj did it complete ok? or barf?
10:53 Waylon said it completed okay.
10:53 mtj do yu have a stable koha to compare against?
10:53 Waylon [log] Records: 196893 i/u/d 196893/0/0
10:54 mtj that looks good
10:54 Waylon hmm? only the koha currently in production.
10:54 eythian joined #koha
10:54 Waylon thats 3.0
10:55 Waylon [log] Iterations: isam/dict 291501887/3024638
10:55 mtj my advice…. sort a stable koha to compare against
10:55 Waylon [log] Dict: inserts/updates/deletions: 3024638/0/0
10:56 mtj if you get different outputs to your stable koha, you've got a debuggable problem
10:58 mtj so, is your zeb-rebuild behaving similar to your stable koha
10:58 mtj is your zebrasrv behaving similar to your stable koha
10:59 mtj if no, you've got a debuggable problem - if yes, you've got a trickier problem :/
10:59 Waylon turned on debug level logging in koha-zebra..
11:00 Waylon huh.. new Zebra doesn't give the query used?
11:00 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Got PDU, 119 bytes: lead=B4 75 83
11:00 Waylon 05:56:56-16/09 zebrasrv(1) [debug] server select: config=/usr/local/apps/koha/kohadev​-etc/etc/zebradb/zebra-biblios.cfg
11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] bend_init
11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] zebra_open zs=0x1250570 returns 0x1250e20
11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Sort handler installed
11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Search handler installed
11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] ESRequest handler installed
11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Delete handler installed
11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Scan handler installed
11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Segment handler installed
11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug]   result immediately available
11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] ir_session (output)
11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] Wrote PDU, 183 bytes
11:01 Waylon 05:56:56-16/09 zebrasrv(1) [debug] zebra_close zh=0x1250e20
11:01 cait joined #koha
11:02 cait left #koha
11:02 Waylon thats all there is.
11:02 mtj http://paste.koha-community.org/
11:02 Waylon hm. right.. ah.. too late
11:03 mtj so, what happens if you do a search?
11:03 Waylon that is from a search
11:04 Waylon from a intranet search
11:05 Waylon mandumah.com, working server, is zebra 2.0.43, the new server in devel, is zebra 2.0.52
11:05 Waylon hmmmmmmm..
11:05 mtj hmm, perhaps use the new zebra conf files, much has changed since 3.0
11:05 Waylon right, but that would take out all the customization that mandumah did.
11:06 mtj do a diff, lots of changes yeah?
11:06 mtj yep, you would lose those mods :/ but at least you might have a working search… to start with
11:07 Waylon maybe.. okay.. ill swap the configs.
11:07 mtj make sense, yeah
11:08 mtj use git on your zebra files
11:08 Waylon on its way.
11:08 mtj start fresh and functioning, then add your mod...
11:08 mtj when it breaks, your last added mod was the problem
11:09 Waylon if this works, guess i will have to manually go through the marc setup.
11:18 jenkins_koha Project Koha_3.8.x build #175: SUCCESS in 1 hr 1 min: http://jenkins.koha-community.[…]b/Koha_3.8.x/175/
11:18 jenkins_koha Chris Cormack: Bug 7409 : Fixing typo
11:18 huginn Bug http://bugs.koha-community.org[…]w_bug.cgi?id=7409 normal, P5 - low, ---, robin, Needs Signoff , Missing dependencies for Debian package
11:18 jenkins_koha Starting build #176 for job Koha_3.8.x (previous build: SUCCESS)
11:19 mtj hmm, usually no - but if youve heavily tweaked your zebra files and marc framework, …then perhaps?
12:00 Waylon mtj, koha master config, fails.
12:00 Waylon still no results
12:06 jcamins_away Sounds like you adjusted your Zebra configuration in a non-compatible way.
12:08 Waylon hrm.
12:08 jcamins_away Actually, looking at the output you pasted into the channel, sounds like Zebra isn't running.
12:08 Waylon i mean, koha master zebra config fails.
12:08 Waylon ah? zebra is running.
12:10 jcamins_away This bread is amazing.
12:10 Waylon huh?
12:11 jcamins_away In that case, I think I'm back to theory A: you made non-compatible changes to your Zebra config and are storing necessary data in strange places.
12:14 lodac joined #koha
12:14 lodac Morning
12:15 lodac I work in the education sector (k-12). Any recommendation of some American based companies that would provide support to a koha user for a district?
12:15 lodac paid of-course
12:16 jcamins_away support?
12:16 wahanui support is probably found at http://koha-community.org/support/
12:16 jcamins_away paid support?
12:16 wahanui please see http://koha-community.org/support/paid-support/ for a list of paid Koha support vendors.
12:16 jcamins_away ^^ there is a list, though not everyone is on it (I'm not, for example)
12:17 lodac I notice that list for US is 247 days old... so that is why I asked here
12:17 jcamins_away That list is kept up to date.
12:17 lodac jcamins_away: are you looking for customers?
12:17 jcamins_away lodac: responding off-channel
12:20 jenkins_koha Project Koha_3.8.x build #176: SUCCESS in 1 hr 1 min: http://jenkins.koha-community.[…]b/Koha_3.8.x/176/
12:27 Waylon any way to examine the contents of the zebradb?
12:27 Waylon without asking a specific query?
12:29 jcamins_away Waylon: not easily, no.
12:31 Waylon ooo.
12:31 Waylon got it working
12:31 Waylon in -v all
12:31 Waylon mode.
12:32 Waylon hmmmmm..
12:35 Waylon okay, yay. hmm
12:41 jcamins_away Waylon: what was the problem?
12:42 Waylon not sure. running it again with the old zebra config.
12:42 Waylon and reindexing
12:42 wajasu maybe you might want to look into the yaz-client?
12:43 jcamins_away ^^ good ides
12:43 jcamins_away *idea
12:43 jcamins_away yaz?
12:43 wahanui rumour has it yaz is from IndexData and the Koha XSLT filters are essentially copied from YAZ
12:43 jcamins_away yaz client?
12:43 jcamins_away troubleshooting with yaz client?
12:44 wajasu man yaz   and man yaz-client will help
12:45 jcamins_away understanding zebra indexing?
12:45 jcamins_away understanding zebra indexing is http://wiki.koha-community.org[…]ng_Zebra_indexing
12:45 jcamins_away yaz client is http://wiki.koha-community.org[…]ng_Zebra_indexing
13:27 cait joined #koha
13:30 jcamins_away mtj: 8210 is rebased
14:00 tcohen joined #koha
14:10 Waylon zebra?
14:10 wahanui it has been said that zebra is a fielded free text indexing and retrieval engine with a Z39.50 front-end. You can use any compatible, commercial, or freeware Z39.50 client to access data stored in Zebra. or the search engine koha uses
14:11 Waylon zebra troubleshooting is see [understanding zebra indexing] and [yaz client]
14:11 Waylon zebra troubleshooting?
14:11 wahanui well, zebra troubleshooting is see [understanding zebra indexing] and [yaz client]
14:11 Waylon okay, bed time.
14:11 Waylon laters all
14:27 drojf joined #koha
14:55 cait joined #koha
14:55 chris_n` joined #koha
14:57 cait left #koha
15:23 tcohen hi #koha
15:24 tcohen mtj, have you seen bug 8773?
15:24 huginn Bug http://bugs.koha-community.org[…]w_bug.cgi?id=8773 enhancement, P5 - low, ---, tomascohen, Needs Signoff , Add per-instance koha-index-daemon in .deb setup
15:59 tomas joined #koha
16:30 mib_3j8e4w joined #koha
17:11 cait joined #koha
17:27 mbalmer joined #koha
17:51 cait joined #koha
17:56 * cait waves
18:26 drojf1 joined #koha
18:34 mbalmer left #koha
18:47 cait hi drojf :)
19:27 rangi @wunder nzwn
19:27 huginn rangi: The current temperature in Wellington, New Zealand is 12.0°C (7:20 AM NZST on September 17, 2012). Conditions: Rain Showers. Humidity: 94%. Dew Point: 11.0°C. Pressure: 29.65 in 1004 hPa (Steady).
19:28 cait ew
19:28 cait @wunder Konstanz
19:28 huginn cait: The current temperature in Taegerwilen, Taegerwilen, Germany is 12.8°C (9:25 PM CEST on September 16, 2012). Conditions: Clear. Humidity: 88%. Dew Point: 11.0°C. Pressure: 29.98 in 1015 hPa (Steady).
19:32 wajasu i played with DBIx last night.  I used the DBIx::Class::Schema::Loader to completely generate DBIx classes for our schema. wrote some simple queries using the objects.
19:33 rangi Yep there's a branch with that all done
19:33 rangi The schema is all that interests me
19:33 wajasu now i a thinking of using them to help write tests.
19:33 rangi Specially ::versioned
19:34 wajasu do you want to use the db schema migration stuff?
19:34 rangi Hmm I wouldn't ... You wouldn't be testing the actual queries if you did that
19:35 rangi But yes instead of updatedatabase.pl and the .sql
19:35 rangi Use versioned schema
19:37 wajasu plus it has that DateTime component.  it would be nice to have time/durections normalized so folks writing scheduling/calender sensitive stuff would have an easier time.
19:38 wajasu durections/durations
19:39 wajasu i was thinking if someone wrote a OO domain model, that used the DBIx underneath, we could write tests for all the DB layer and the OO domain and services. before the implementation
19:41 wajasu we could assign bugs to folks to code/wire up the implementations, and uncomment the tests as part of the bugs.  then we could get the tests written.
19:41 rangi Yep but in the mean time (next 3 feature releases at least) we need to go from 56 to close to 100
19:41 rangi Coverage
19:42 rangi Before we start a major rewrite
19:42 rangi Or we will break tons more than we fix
19:42 cait good point
19:42 rangi Rewrites are fun
19:43 rangi But gotta do the hard work first
19:43 wajasu ok. so that is the plan. i'm with you.  so as i get more familiar with the codebase, i should just write tests so we don't fall behind.
19:43 rangi That would be awesome
19:46 wajasu for consistency sake, i would like a nice new OO domain model in there.  I wish I could test against that with the implementation calling our current stuff. then let people rewrite the implementations, while keeping the tests passing.
19:47 rangi OO isn't a panacea and shouldn't be thrown at everything
19:48 rangi Especially structures that you have to coerce into being an object
19:48 wajasu true. but encapsulation is the goal.  composition...
19:48 rangi But I mostly agree with u
19:48 rangi Goal is a fast system for end users
19:49 rangi Everything else is a means to that
19:50 wajasu thats why i want to set up a stack with and without layers (with erformance/profiler, etc).
19:50 rangi Fast and stable
19:52 wajasu i did a reverse engineer of the db a coupld of months ago in java/hibernate, and there a number of schema issues (nullable keys, etc). when i did the same with DBIx, those issue are still there.
19:52 wajasu so as the architects discover them, i guess they can write a bug and baby step the schema to where is need to be.
19:52 rangi Fixing kohastructure.sql would be the first step then
19:55 rangi My stop bbiab
20:16 kathryn joined #koha
20:19 wajasu http://wiki.koha-community.org[…]Coding_Guidelines has a link under (PERL13) POD that is broken these days.
20:25 jcamins_away rangi: I think I have to call BS on rewrites being fun.
20:26 jcamins_away Rewrites suck, and make me grouchy.
20:26 rangi people should stop doing them then
20:26 rangi or at least stop making them the first thing they do, rather than the last
20:26 rangi cos every rewrite of a major feature in koha, to this point
20:27 rangi has been a huge pita for the next at least 6 months
20:27 jcamins_away This is true. Unfortunately, C4::Search is still sitting there, mocking our attempts to make any arbitrary input from the user work.
20:28 cait jcamins_away: but you started with writing tests for it :)
20:28 * cait is optimistic
20:28 * magnuse too
20:28 jcamins_away cait: I did.
20:28 jcamins_away And it's a damn fine test, if I say so myself.
20:29 magnuse hehe
20:29 cait :)
20:29 cait hi magnuse :)
20:29 wajasu i also wish there was separate "test" dependencies.
20:29 magnuse hiya cait
20:30 wajasu if say i want to use Test::Spec for BDD and write 50 tests.  i wouldn't want that to affect production deps.
20:30 jcamins_away wajasu: add it as optional.
20:30 wajasu ahh
20:30 jcamins_away I don't see any problem with that.
20:30 rangi and make it not in t/
20:30 rangi but lower
20:31 rangi because if it is in t/
20:31 jcamins Right.
20:31 rangi its not optional it is mandatory
20:31 wajasu gotch. like db_dependent
20:32 rangi yep
20:33 jcamins Or t/bdd/
20:34 wajasu getting back to the DBIx test idea.  i want to use th DBIx::Class::Schema::Loader to generate  OO code that is independent from the DB (myslq/postgres), then call our code, but use the DBIx classes to inspect the results. so when we rewrite, only the current calls have to be coded in the given: when: then scenarios.
20:35 jcamins wajasu: if that technique can test functionality *now* it sounds like a fine idea.
20:35 wajasu and the tests are more db independent
20:36 wajasu i'll try it out on something simple,  then something complex and you let me know if its good to go.
20:36 jcamins wajasu: as long as the tests give meaningful results, I will support the inclusion in Koha.
20:39 wajasu ok.
20:42 wajasu oh. by the way tried that XML::Easy and replaced XML::Simple.  Did the load_testing/benchmark_staff.pl  and got the same results.
20:44 wajasu i did notice: the zebra config sections have XIncludes and go grab those files and parse them as well. (XML::Simple does I assume), not that it makes a difference.
20:45 jcamins wajasu: actually, the Zebra config sections are not used, I think.
20:46 jcamins marcelr just reported that.
20:46 wajasu i wonder if creation of a new db connection is the issue, or if the fact that many places don't dbh->disconnect, causes mysql to "timeout" before cleanup.
20:46 jcamins wajasu: huh?
20:47 jcamins the first question?
20:47 wahanui "What are you trying to do?"  "What is the goal?" or "What problem are you experiencing?"
20:49 wajasu i was in C4, and grepped for dbh->disconnect.    I read that CGI supposedly cleans up?  but i also read on a site that if we don't cleanup the resource at the end of scripts, the database may have to "timeout".  so since i was running the apachebench benchmark, i wonder.
20:49 jcamins wajasu: so what is the problem you've encountered?
20:50 wajasu i'm wondering why/how that bug wants to get more performance.
20:50 wajasu the removal of XML::Simple.   I understand about memcache probably taking care of it.
20:51 jcamins What bug? XML parsing has nothing to do with connecting to MySQL.
20:52 wajasu bug 7170.
20:52 wahanui bug 7170 is what I was looking at
20:52 huginn Bug http://bugs.koha-community.org[…]w_bug.cgi?id=7170 normal, P3, ---, paul.poulain, REOPENED , Remove use of XML::Simple
20:52 jcamins Right, that has nothing to do with MySQL.
20:52 jcamins That is about how long it takes to parse koha-conf.xml.
20:53 wajasu i left the XML::Simple in, and added the parsing with XML::Easy  and the benchmark ran with the same time.
20:54 jcamins Right, it's not an important bug.
20:58 wajasu i was trying to understand if there was a perfomance issue setting up Context.pm  "too many queries, plus perl startup, plus db connection(no connection pool). And if that was the driving force to plackify.  If so, we should code a plackified context and benchmark.
20:59 jcamins C4::Context is not very efficient, but the bigger issue is the overall load time.
21:00 jcamins The difference between 22ms and 20ms just isn't that big a deal when you're talking about a total load time of 400ms+.
21:02 jcamins If you want to see what I'm talking about, run the following command: perl -MDevel::NYTProf -e "use C4::Search; use C4::Circulation; print 'Hello, world!';"
21:02 jcamins Then take a look at the results.
21:02 jcamins Obviously the faster your computer the less dramatic it will be.
21:03 wajasu ok. i will.
21:03 wajasu you mean the load time for perl.  right?
21:04 jcamins Load time for Koha's modules.
21:04 wajasu ahh.
21:04 jcamins I think I rembered the correct modules for the most dramatic effect.
21:04 jcamins *remembered
21:05 Jared joined #koha
21:05 jcamins ^^ not me
21:06 rangi heh
21:06 Jared Hello, I'm looking for information on Koha - Zebra permissions.  I'm installing on Fedora and am getting "Search biblios ERROR 109" from zebrasrv.
21:08 jcamins Jared: have you reindexed yet?
21:08 Jared files in "/var/lock/koha/zebradb/" are owned by the system user "koha".  Is this the same user as what is in /etc/koha/zebradb/zebra-biblios.cfg?
21:10 Jared Have I reindexed?  I think so.  I have run "/usr/share/koha/bin/migrat​ion_tools/rebuild_zebra.pl -v -v -b -a"  I can send the output if that is helpful.
21:10 jcamins Jared: no. Zebra user and system user are unrelated.
21:10 Jared This is a new install...not an upgrade.  I did put one card/item in the catalog.
21:11 jcamins Jared: stick the output in paste.koha-community.org.
21:11 jcamins Full disclosure: I dislike non-Debian systems because they don't play nicely with Koha.
21:12 pastebot "Jared" at 127.0.0.1 pasted "rebuild script output" (29 lines) at http://paste.koha-community.org/175
21:12 jcamins Umm, add another -v.
21:13 Jared jcamins, can you describe how the permissions work?  HTTPd runs as user "apache"...that then calls out to zebrasrv.  zebrasrv (somehow) connects to actual files on the filesystem.
21:13 Jared I added another -v, output is the same.  I can re-paste
21:13 jcamins No need.
21:14 jcamins See above about my hatred of non-Debian systems. ;)
21:14 jcamins zebrasrv is running as your koha user.
21:14 Jared Is there any concern about using a version of zebra that is too new?
21:14 jcamins The CGI script connects via socket.
21:14 jcamins No.
21:14 Jared yes, zebrasrv is being run after "su koha -"
21:16 jcamins You must run rebuild_zebra as that same user.
21:16 jcamins All Zebra files must be owned by that user.
21:17 jcamins However, 109 isn't a permissions error, I don't think... that sounds like a "Zebra isn't being run with the correct configuration" error to me.
21:17 Jared I did run rebuild_zebra as that user.
21:17 Jared as far as I can tell, everything under /var/*/koha is owned by koha.koha
21:18 jcamins Yeah, so I think the problem you're running into is that Zebra is failing to use your configuration file.
21:18 jcamins Wait, how are you starting Zebra?
21:19 Jared how am I starting zebrasrv?  For now just on the command-line: "/usr/local/bin/zebrasrv -v all -f /etc/koha/koha-conf.xml"
21:19 * jcamins adds for the benefit of those just joining it that "Jared" is not me.
21:19 jcamins Paste that into paste.koha-community.org?
21:20 jcamins *in
21:20 Jared I can paste the output of ls -l on /var/*/koha...but all of the permissions look ok
21:20 Jared I'll paste the zebrasrv output first.
21:20 jcamins No, nothing to do with permissions.
21:20 jcamins You should be getting a ton of output from zebrasrv.
21:21 pastebot "Jared" at 127.0.0.1 pasted "zebrasrv output showing error 109 (Fedora)" (109 lines) at http://paste.koha-community.org/176
21:22 Jared Is debian the only "officially" supported OS distro for koha?
21:22 jcamins Jared: I don't know about "official," but certainly you'll get a lot more help with Debian/Ubuntu.
21:23 jcamins Jared: try using yaz client directly.
21:23 jcamins yaz client?
21:23 wahanui yaz client is http://wiki.koha-community.org[…]ng_Zebra_indexing
21:24 Jared same error if I use Yaz client.  I can do it again, but previously, I got identical stuff in the zebrasrv log
21:24 jcamins I want to know what it says *before* you do the search.
21:24 jcamins When you connect to the server and set the database.
21:26 Jared from the yaz-client?
21:26 jcamins Right.
21:27 wajasu http://koha.1045719.n5.nabble.[…]em-td3072111.html
21:27 jcamins It should give you some sort of diagnostics, as I recall.
21:28 Jared there is some extra info, but it appears (to me) to connect to zebrasrv ok
21:28 jcamins Jared: hm, nothing about unrecognized option?
21:30 Jared I did paste the yaz-client output...but didn't see the paste link.  I'll paste it again.
21:31 pastebot "Jared" at 127.0.0.1 pasted "yaz-client output" (24 lines) at http://paste.koha-community.org/178
21:35 jcamins Jared: try doing the database init thing.
21:35 jcamins You won't get any results, but you might not get the error after it's done.
21:35 jcamins faq?
21:35 wahanui well, faq is found at http://koha-community.org/documentation/faq/
21:35 Jared database init is the reindex_zebra script?
21:36 jcamins No.
21:36 jcamins At the end of that file it has a suggestion of resetting your Zebra indexes.
21:36 jcamins Under "I have double ups..."
21:36 jcamins Oh, the init was removed.
21:37 Jared can you clarify "the database init thing"  Are you referring to "koha-rebuild-zebra"?
21:38 jcamins So, run that drop command, then do: zebraidx -c /path/to/zebra-biblios.cfg -d biblios init
21:38 jcamins I am telling you what to do.
21:38 jcamins Then do the commit.
21:38 Jared ok.  Do this as the koha user, I assume
21:38 jcamins Yes.
21:39 jcamins What version of Koha are you using?
21:39 jcamins I should have asked this first.
21:43 pastebot "Jared" at 127.0.0.1 pasted "biblios rebuild" (48 lines) at http://paste.koha-community.org/179
21:43 jcamins Ah-ha.
21:43 jcamins This is helpful.
21:43 jcamins Let me figure out what it helped us find out.
21:44 Jared interestingly, it says there was no biblios db when dropping it.
21:44 Jared I have installed Koha koha-3.08.04
21:44 rangi id do the create before rebuild_zebra see if that fixes it
21:45 wajasu database unavailable:  the user/pass OR the perms usually.    following the KOHA_CONF to the koha-conf.xml  /var/lib/koha/...  make sure the user you run zebrasrv as has perms to read/write all the way  down that heirarchy.
21:47 jcamins wajasu: this isn't the standard no permissions error, though, I don't think.
21:48 jcamins Jared: share ls -l /var/lib/koha?
21:48 Jared wajasu: Yes, everything under /var/lib/koha is koha.koha
21:48 jcamins ls -lR
21:48 pastebot "Jared" at 127.0.0.1 pasted "/var/lib/koha permissions" (65 lines) at http://paste.koha-community.org/180
21:50 jcamins Interesting way of doing ls -lR. :)
21:52 pastebot "jcamins" at 127.0.0.1 pasted "Jared (not me): try this" (2 lines) at http://paste.koha-community.org/181
21:53 jcamins Jared: as you probably gathered, my name is also Jared, and it's kind of throwing me. ;)
21:54 pastebot "Jared" at 127.0.0.1 pasted "Output of zebraidx commands. zebrasrv still returns error 109" (52 lines) at http://paste.koha-community.org/182
21:55 Jared It's good to know there's another Jared out there.  There aren't too many
21:56 jcamins When I was younger, I had a class with another Jared.
21:58 jcamins I have no idea what's going on there.
21:59 Jared So, I'm trying to recap.  You had be run 4 zebraidx commands in an attempt to rebuild  zebra-biblios and zebra-biblios-cfg
21:59 Jared sorry, zebra-biblios and zebra-biblios-dom
21:59 jcamins The first set was incorrect.
21:59 jcamins I caught that after the fact.
22:00 jcamins It should have been zebra-biblios-dom all along.
22:00 Jared Some more context for you, I have fedora, have installed all of the perl modules (via cpan)
22:00 Jared I have yaz-3.0.49-1.fc13.x86_64 instaled as an RPM via yum
22:01 Jared I have idzebra-2.0.52 installed via a tarball
22:02 Jared and I have koha 3.08.04 installed.  When installing, I accepted all of the defaults from Makefile.PL
22:02 jcamins Oh, I bet I know what it is.
22:02 Jared I did run the install twice (make uninstall and re-ran gunzip & tar)  Same effect both times.
22:03 jcamins Did you open up the zebra-biblios-dom.cfg file and make sure that all the paths listed match where your files ended up?
22:03 jcamins In particular, I think there's a modulePath directive that is likely to be wrong.
22:05 Jared yes that path is wrong
22:06 jcamins Well, it took a while, but I knew we'd find it eventually. :)
22:09 Jared still getting error 109
22:09 jcamins Well, yes, that wasn't what was causing the problem.
22:10 Jared sorry, I'm on the phone for a few minutes.... Appreciate your ideas.  The module path was definitely wrong
22:17 Jared Hi, sorry about that.
22:18 jcamins We need a "select all" button in the webinstaller.
22:18 Jared Do I need to drop and rebuild the databases and rerun the rebuild_zebra script?
22:18 jcamins Or to make the test clickable.
22:19 jcamins Yeah, repeat the init thing.
22:19 Jared ok, will do
22:19 Jared do authorites-dom and biblios-dom or all 4?
22:20 jcamins zebra-biblios-dom
22:20 jcamins The init and commit commands.
22:21 jcamins Hey, the password field on master is an actual password box.
22:21 jcamins Nice!
22:22 rangi 3.8.x too
22:23 jcamins Oh, I haven't created any new users in my 3.8.x installs.
22:24 pastebot "Jared" at 127.0.0.1 pasted "Rebuild steps" (3 lines) at http://paste.koha-community.org/183
22:24 Jared hmm, so despite the changes, I still get error 109.
22:25 jcamins And you got no output?
22:25 Jared one other thing I did notice, is that by default, stuff is installed to /usr/local/bin, which is not in the default path on fedora.
22:25 jcamins Also, try just those first two lines.
22:27 mib_05oev3 joined #koha
22:32 cait left #koha
22:34 Jared I think the takeaway is that this zebra stuff just doesn't work on fedora/centos/rhel.  I'd encourage you to document this somewhere
22:34 Jared I'll have to setup a debian install and test it again there.
22:35 jcamins Jared: I think we've documented it repeatedly.
22:35 jcamins And it's not that it can't be made to work.
22:35 Jared then my apologies, I missed it.  What is the best supported distro...latest debian?
22:35 jcamins One developer uses Fedora.
22:36 jcamins Jared: no, that was documented, past tense. I don't think it's so much that you missed it as the "use Debian" recommendation was replaced with "here's how I got an old version of Koha to almost run on Fedora."
22:36 jcamins Yeah, Squeeze is the way to go.
22:36 jcamins packages?
22:36 wahanui packages is, like, at http://wiki.koha-community.org/wiki/Debian
22:36 jcamins ^^ follow that guide.
22:36 jcamins It's dead simple.
22:49 wajasu http://www.loc.gov/z3950/agenc[…]fns/bib1diag.html
22:50 wajasu i always have to run zebra as root.
22:50 jcamins wajasu: then you have your system set up wrong.
22:50 jcamins If you're satisfied with that, though, I suggest you just leave it.
22:50 wajasu i could not infer it fromthe INSTALL instructions. 4 years ago.
22:50 wajasu the problem was apache was so different from debian
22:51 wajasu none of the same command line tools that apache has.  but i was on archlinux.
22:52 wajasu i'm about to upgrade to 3.10 once that's released.
22:53 wajasu and run debian in a VM.
22:55 wajasu it would take 4hours to assemble dependencies from cpan, and build archlinux packages.  perl didn't have but a couple of koha's deps. so i saw the light. debian.
23:21 papa joined #koha
23:30 libsysguy joined #koha
23:33 libsysguy joined #koha
23:45 wajasu jcamins: that nyt report is great. thx
23:45 jcamins wajasu: you're welcome. Kind of extraordinary, isn't it, how long it takes for Koha modules to load?
23:46 wajasu yup.
23:50 wajasu i got 1.29secs total with koha running in a VM with /home/koha/kohadev in the VM filesystem and /home/koha/kohaclone sshfs mounted to my hostOS.
23:51 jcamins Heck of a lot faster than on my laptop.
23:51 jcamins 2.57s.
23:52 wajasu so the more deps the slower.  but if they plackify, they are preloaded, and only what is needed is run in on plackified scripts. right ?
23:53 jcamins Right.
23:53 jcamins The BEGIN blocks are run exactly once under Plack.
23:57 wajasu i am really glad you are getting search up to par.   i hope with your future search plugins, you make a composable plugin, where one can stack them, and configure it so that (a) if no results, run the second, (b) run in parallel with immediate results from one, and asynchronous ajaxified rsults arriving right behind.
23:58 wajasu but i know there is alot of work to do before that.
23:58 jcamins I am designing the system so it would be possible to do that.
23:59 wajasu i could tell.

| Channels | #koha index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary