Time Nick Message
00:45 oleonard Hi "night" shift
00:46 pianohacker wow, you're here late.
00:47 oleonard Isn't this late for you too pianohacker?
00:47 pianohacker well, yes...
00:48 oleonard Is there a formal plan for ES testing tomorrow?
00:50 pianohacker I do not think so, beyond what Brendan posted
01:13 oleonard Hi dcook
01:13 dcook heya oleonard :)
01:14 oleonard Thanks for your nice words on my Bootstrap bug
01:14 dcook No worries. You are awesome ^_^.
01:15 oleonard I managed to do a lot of yak-shaving today related to that
01:15 dcook I know in the past I expressed some reserve at moving to v3 as well, so I wanted to clarify that I've reversed that opinion.
01:15 dcook Oh yeah?
01:15 oleonard I know you've dealt with more recalcitrant users than most :)
01:15 dcook I think the users are often receptive, but their IT departments are not :(
01:16 dcook I heard a story about one department that only got to use Chrome after the whole ministry updated their website but it wouldn't work on the version of IE that was mandated for the ministry
01:16 dcook I would've loved to be there at that Monday morning panic...
01:17 oleonard Bug 16241 and Bug 16242 (not to mention Bug 15883) are all steps towards a Bootstrap upgrade in the staff client
01:17 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16241 enhancement, P5 - low, ---, oleonard, Needs Signoff , Move staff client CSS out of language directory
01:17 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16242 enhancement, P5 - low, ---, oleonard, Needs Signoff , Move staff client JavaScript out of language directory
01:17 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=15883 normal, P5 - low, ---, oleonard, Needs Signoff , Upgrade jQuery from v1.7.2 in the staff client
01:18 oleonard ...because I think we'll have to make our own build of Bootstrap if we want to do an incremental upgrade (not converting the templates 100%)
01:20 dcook I hope it's not too difficult :(
01:20 dcook Btw, excited about the jQuery upgrade
01:21 oleonard It's a pain, but it's worth it.
01:21 oleonard Anyway, everyone sign off on all of those bugs and good night! I'll be back in 10.5 hours!
01:21 dcook oleonard++
01:25 dcook I wonder if we could make stubs for templates and .pl scripts...
02:26 wizzyrea @wunder nzwn
02:26 huginn wizzyrea: The current temperature in Wellington, New Zealand is 20.0°C (2:00 PM NZST on April 12, 2016). Conditions: Mostly Cloudy. Humidity: 73%. Dew Point: 15.0°C. Pressure: 29.83 in 1010 hPa (Steady).
02:26 wizzyrea 20!
02:26 wizzyrea shocking.
03:43 mtj_ hey wiz++, thanks muchly for your patch on 13216 :0)
03:47 wizzyrea oh, I'm just glad it was kinda sorta useful.
03:47 wizzyrea it could go much much further
04:05 mtj_ yeah, its a fiddly thing to 'fix'
04:18 mtj_ but... i have now have a general plan that should work well - fingers xrossed
04:21 wizzyrea \o/
05:26 drojf morning
05:33 dcook morning drojf
05:33 dcook And blarg for non-persistent environments...
05:33 dcook Maybe I should be using the new REST API... although I know nothing about it or if it's even a thing now...
05:33 drojf hi dcook
05:37 dcook Oh I forgot that fredericd left me with a nice Koha::OAI::Client namespace... huzzah
06:13 drojf @later tell rangi is libcatmandu-store-elasticsearch-perl the only catmandu module we use that is not in jessie?
06:13 huginn drojf: The operation succeeded.
06:15 * magnuse waves
06:21 drojf hei magnuse
06:25 * drojf runs off to the catmandu workshop
06:50 reiveune hello
06:50 wahanui privet, reiveune
07:15 dcook I wonder if we're translating the whole error string when using C4::Biblio::DelBiblio...
07:19 gaetan_B hello
07:19 alex_a Bonjour
07:27 * magnuse waves again
07:29 * cait waves
07:30 * dcook waves and heads home
07:42 magnuse drojf: have fun with catmandu!
07:44 drojf magnuse: i will :)
07:44 drojf as far as i can follow the discussions :)
07:51 drojf did anyone set up koha+ES lately and can tell me if the deb files in the archive are needed or only the unpacked deb files? http://debian.koha-community.org/koha/otherthings/
07:53 magnuse cait has been installing Koha+ES, i think?
07:54 drojf i think she gave up due to an outdated os?
07:54 magnuse ah, maybe
07:54 * magnuse is also stuck on 14.04
07:55 drojf fwiw i do not seem to have libelasticsearch-searchbuilder-perl or libsearch-elasticsearch-compat-perl on my ES test vm, so i'd say only the unpacked deb files are needed
07:56 drojf magnuse: i can share my VM if you want to try it
07:56 drojf but i think there will be a test machine by bywater too
07:58 magnuse thanks, but no time at the moment
07:59 drojf more play, less work ;)
08:03 magnuse yes please :-)
08:03 * magnuse has a raspberry pi 3 model b sitting on a shelf
08:12 pastebot "teachcolby" at 127.0.0.1 pasted "ILL Module" (1 line) at http://paste.koha-community.org/407
08:14 drojf magnuse: did you install koha on it?
08:14 drojf i did not buy a 3 so far. but i would love to see how 3.22.5 with plack compares to 3.22.0
08:15 drojf that's a funny paste
08:16 * teachcolby slaps drojf around a bit with a large fishbot
08:18 pastebot "teachcolby" at 127.0.0.1 pasted "ILL Module" (2 lines) at http://paste.koha-community.org/408
08:20 drojf teachcolby: i guess you are in the webchat? there should be a field to enter text somewhere?
08:20 Joubu :)
08:23 gaetan_B has anyone tried Koha Ubuntu 16.04 yet ? (Xenial Xerus, the new LTS)
08:23 pastebot "teachcolby" at 127.0.0.1 pasted "I'm using a paste it function" (1 line) at http://paste.koha-community.org/409
08:25 drojf teachcolby: the easy version would be to use the actual chat. there should be a test field at the very bottom of the page?
08:25 drojf anyway there is work being done on an ILL module, see https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=7317
08:25 huginn 04Bug 7317: new feature, P5 - low, ---, alex.sassmannshausen, NEW , Add an Interlibrary Loan Module to Circulation and OPAC
09:16 cait magnuse: cait tried but got stuck on her os - will update my ubuntu this weekend after backup :)
09:49 magnuse cait: ah, gotcha
10:02 magnuse drojf: i didn't even power it on yet :-)
10:02 magnuse lunchtime!
10:02 wahanui lunchtime is a terrible time for a meeting
10:02 magnuse yup
10:56 drojf i have some data missing fields. like 100 and 245. i really hope that was faulty test data and nothing that happened because of ES
11:19 cait drojf++
11:50 oleonard Hi #koha
11:53 oleonard is there a guide to getting Elastic Search set up locally for testing, or is it better to use someone else's test server?
12:04 kidclamp oleonard: https://wiki.koha-community.org/wiki/Elasticsearch
12:18 oleonard Good morning, my fellow Americans.
12:22 nengard good morning!
12:22 wahanui the only good morning is a dead one
12:22 nengard um
12:22 nengard that's sad
12:22 nengard heh
12:23 oleonard wahanui: Don't worry we're killin' this morning
12:23 wahanui oleonard: sorry...
12:39 * magnuse waves to the americans
12:41 oleonard I can't see how authorised value images are displayed in the OPAC at all with XSLT turned on.
12:42 oleonard The preference doesn't have any effect on the advanced search page, which always displays images for ccode.
12:46 drojf ha, my problem seems to be that there is auth data stored as biblios. i did not even know that is possible, i must have screwed that up myself
12:54 cait oleonard: i think that's what Joubu said somewhere too - non-functional for xslt
12:55 cait but proably still slowing us down
12:56 oleonard I'm commenting on the bug... I think we need to remove both preferences altogether.
12:56 oleonard I don't see a purpose for them.
12:56 magnuse off with their heads!
12:56 magnuse @wunder boo
12:56 huginn magnuse: The current temperature in Bodo, Norway is 4.0°C (2:50 PM CEST on April 12, 2016). Conditions: Mostly Cloudy. Humidity: 75%. Dew Point: 0.0°C. Windchill: -1.0°C. Pressure: 29.98 in 1015 hPa (Steady).
12:56 magnuse snowing, akshuly
12:57 oleonard @wunder 45701
12:57 huginn oleonard: The current temperature in Heatherstone, Athens, Ohio is 6.1°C (8:57 AM EDT on April 12, 2016). Conditions: Clear. Humidity: 58%. Dew Point: -2.0°C. Windchill: 6.0°C. Pressure: 30.25 in 1024 hPa (Rising). Freeze warning in effect from 2 am to 9 am EDT Wednesday...
12:57 cait oleonard: i think having icons for location and maybe lost values... or restricted values
12:57 cait coudl be nice... but i think on the result lsit it's not necessary
12:57 cait if at all i'd limit it to the detail view
12:58 oleonard cait: Could be nice, but Koha doesn't do it
12:58 cait ah
12:58 cait i thought detail was functional
12:58 oleonard Not with XSLT on as far as I can tell.
12:58 cait so we only keep the option for adv search?
12:58 cait we have a library using htat
12:58 cait for locations
12:59 oleonard the adv search page shows the images no matter what. It doesn't check any pref
12:59 cait cool
12:59 cait and Joubu is not remoing the add an icon to the auth values I hope - so that should be fine
13:01 oleonard Oh, duh.
13:01 oleonard Bug 16167
13:01 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16167 enhancement, P5 - low, ---, jonathan.druart, Needs Signoff , Authorised value images may be removed
13:01 oleonard Then why Bug 16041?!
13:01 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16041 normal, P5 - low, ---, jonathan.druart, Needs Signoff , StaffAuthorisedValueImages & AuthorisedValueImages preferences - impact on search performace
13:01 oleonard *sigh*
13:04 oleonard Oh, bug 16041 removes the option to show images altogether... so no more images on the adv search page :(
13:40 jajm oleonard, bug 16154 applies well for me, are you sure you applied the patches on current master ?
13:40 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16154 normal, P5 - low, ---, jonathan.druart, Patch doesn't apply , Replace CGI->param with CGI->multi_param in list context
13:40 oleonard I thought I was sure jajm, but I will try again
13:40 cait oleonard: going a bit too far then
13:41 cait oleonard: we just added images for locations for a library...
13:41 oleonard cait: Shelving location?
13:41 wahanui rumour has it Shelving location is now in italic underneath the library name
13:41 cait yeah
13:41 cait for adv search page obviously...
13:42 cait as i didn't know it would not work for detail then :)
13:43 oleonard If you had asked me before today I would have said they definitely did work on the detail page.
13:43 oleonard I don't know what version I'm remembering.
13:51 tcohen hi everyone
13:51 tcohen sorry i'm late
13:51 tcohen :D
13:53 cait oleonard: I thought i read in joubus summary that it should work...
13:53 cait so we are 2 people
13:53 cait oh
13:53 cait one sec
13:54 cait hm it was turned off
13:54 cait but turning it on didn't work
14:07 tcohen hi cait
14:08 tcohen kidclamp: did u succeed with kohadevbox and es
14:09 kidclamp as of right now, yes!
14:09 kidclamp but not with 2.x
14:09 kidclamp 1.7.5
14:10 tcohen how is that?
14:10 tcohen http://snag.gy/uXZH2.jpg
14:10 tcohen KOHA_ELASTICSEARCH=1 vagrant provision
14:11 tcohen should end up with 2.x
14:11 drojf tcohen: catmandu and ES 2 are not friends yet. i wrote something yesterday about it
14:11 tcohen ah!
14:11 tcohen ok
14:11 kidclamp yes, but 2.x doesn't work, so I had to do manual
14:11 tcohen i will patch it right now
14:11 cait drojf: around?
14:11 kidclamp I also needed libcatmandu-marc-perl
14:11 drojf kind of
14:12 kidclamp drojf++
14:12 cait tuesday before hackfest - there are no plans yet, are they?
14:12 cait are there...
14:12 cait maybe dinner?
14:12 cait or helping you set up something?
14:12 drojf apart from arranging the room, getting drinks and stuff i think no
14:13 drojf i thought we could have dinner before rangi falls into a coma
14:13 drojf somewhere close to his hotel
14:13 drojf are you staying there btw?
14:13 cait yep
14:13 cait seemed like a good idea
14:14 drojf yeah i think its a good option, i wante dto put it in the wiki
14:14 drojf we should have made a deal with them
14:14 drojf ;)
14:14 cait and i like sticking together in groups somehow :)
14:14 cait although i am a little afraid people will think i am helpful because i speak german
14:15 drojf how can that be helpful? :D
14:15 cait no idea
14:15 magnuse so i understand what subscription.lastvalue1 and subscription.lastvalue2 does, but what does innerloop1 do?
14:15 drojf german is not spoken much in neukölln :D
14:15 cait the position in the loop i think
14:16 cait magnuse: lastvalue = starting point
14:16 magnuse so it's related to periodicity?
14:16 cait hm let me see
14:16 oleonard cait: You're doing a terrible job convincing everyone you're not helpful.
14:17 cait lastvalue = when it jumps over i think
14:17 cait innerloop = current position
14:17 magnuse nah, lastvalue is the last value that was generated, i think?
14:17 cait well it can differe
14:18 cait it's the inner counter
14:18 cait say your last value is 2015
14:18 cait or 2016
14:18 magnuse so if the last issue was "2016 No. 2" lastevalue1 will be 2016 and lastvalue2 will be 2?
14:18 cait inner counter probably 1
14:18 cait let me find a screenshot
14:20 magnuse kia ora JesseM_away
14:20 JesseM hi magnuse
14:20 tcohen kidclamp: libcatmandu-marc-perl from cpan?
14:21 cait magnuse: sorry, only finding old serials examples... still looking
14:21 drojf cait: we can set some time on tuesday to meet at the office and prepare some things if you want to plan that 6 weeks ahead :)
14:22 cait drojf: the problem is i have to plan - giving training the same day :)
14:22 drojf i thought you are on holiday :P
14:23 cait plans change
14:23 drojf tsk
14:23 drojf so when is the training?
14:23 cait tuesday morning
14:23 cait possibly some of the afternoon
14:23 cait so that's why I was asking
14:23 cait :)
14:23 drojf possibly? how can you not know? don't you plan things?
14:23 * drojf hides
14:24 cait you are terrible.
14:24 drojf sorry :)
14:24 drojf i sleept veery little the last days and should go to bed
14:24 drojf slept
14:24 kidclamp tcohen: No!!!! from debian cpan breaks it
14:25 kidclamp from debian. cpan breaks it
14:25 kidclamp what I was struggling with for forever
14:27 tcohen ok, kohadevbox patched
14:29 magnuse tcohen++
14:30 tcohen ES?
14:30 wahanui ES is pretty awesome
14:30 tcohen ES?
14:30 wahanui ES is pretty awesome
14:31 tcohen is there a wiki for toda?
14:31 tcohen y
14:32 kidclamp https://wiki.koha-community.org/wiki/Elasticsearch
14:32 kidclamp for install
14:33 kidclamp for testing the focus is really on ensuring that all zebra functionality continues if ES is installed
14:38 magnuse playing dungeons 'n dragons in the middle of the workday, eh?
14:41 tcohen kidclamp: so we also need to install teh debs on otherthings?
14:42 kidclamp yes, I think only the ones not packaged
14:42 kidclamp sorry not archived
14:42 kidclamp ignore the tar.gz
14:43 oleonard jajm: I tried Bug 16154 again with the same results. "fatal: sha1 information is lacking or useless (admin/patron-attr-types.pl)"
14:43 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16154 normal, P5 - low, ---, jonathan.druart, Patch doesn't apply , Replace CGI->param with CGI->multi_param in list context
14:53 oleonard mveron++
15:05 jajm oleonard, ok it's weird
15:07 tcohen kidclamp: http://snag.gy/YizhW.jpg
15:09 beatsforthemind Hello Koha people
15:10 kidclamp did oyu just update?
15:10 kidclamp tcohen^
15:11 tcohen i run
15:11 tcohen KOHA_ELASTICSEARCH=1 vagrant provision
15:11 tcohen so it re-provisions the VM
15:11 kidclamp Ah, you just added install of those deps to kohadevbox
15:11 tcohen yeap
15:11 kidclamp I was testing a clean run :-)
15:12 kidclamp can the koha-conf.xml update be added?
15:12 tcohen i changed to ES 1.7, and added the deps (from jessie, and ours)
15:12 tcohen kidclamp: I think so ;-)
15:12 tcohen I mean, sure!
15:13 tcohen what should the index_name be?
15:13 tcohen is that the instance name?
15:13 reiveune bye
15:13 kidclamp koha_kohadev
15:13 kidclamp yup
15:13 tcohen ok
15:13 tcohen will do right now
15:13 kidclamp tcohen++
15:14 kidclamp I also have to change the permission on koha-conf each time
15:14 tcohen why is that?
15:14 tcohen the koha-conf file is created by koha-create
15:15 kidclamp I don't know, but I always get Couldn't open /etc/koha/sites/kohadev/koha-conf.xml:
15:15 kidclamp Permission denied at /usr/share/perl5/XML/SAX/Expat.pm line 75.
15:15 kidclamp BEGIN failed--compilation aborted at misc/search_tools/rebuild_elastic_search.pl line 86.
15:15 kidclamp sudo chmod 755 .... and all works
15:16 tcohen kidclamp: maybe you are not running it inside koha-shell kohadev?
15:16 kidclamp I am not, I realized that too
15:17 kidclamp it's a whole extra command that way :-)
15:17 tcohen kidclamp: I usually run byobu
15:17 tcohen and have several tabs on it
15:18 tcohen one for the koha-shell, one for logs, etc
15:19 kidclamp tcohen:I do tabs, but am lazy and want to do everything without koha-shell - I will pay my permissons price
15:19 tcohen hahaha
15:20 eythian kidclamp: the downside is that now you've opened up a password-containing file to be world readable.
15:20 eythian this is why we have things like koha-shell
15:21 kidclamp you are certainly correct eythian, I treat my kohadevbox poorly
15:21 drojf koha's hell
15:21 eythian yeah, devbox is OK, but then you keep the bad habits in production :)
15:23 kidclamp kidclamp--
15:23 huginn kidclamp: Error: You're not allowed to adjust your own karma.
15:23 kidclamp I will try to be better
15:23 drojf eythian: do you remember if we needed liblog-any-perl_1.03-1_all.deb or just liblog-any-perl in general? 0.15 is in jessie and i wonder if that is enough for koha+ES
15:24 eythian not sure
15:24 eythian try it and see if it works :)
15:27 tcohen we should really test in a similar env to that in production
15:30 drojf tcohen: i wanted to try a package installation like a user would do, but i am probably not going to do that today
15:32 tcohen <elasticsearch>
15:32 tcohen <server>localhost:9200</server>
15:32 tcohen <index_name>koha_{{ koha_instance_name }}</index_name>
15:32 tcohen </elasticsearch>
15:32 tcohen oops
15:39 oleonard Isn't it still the case that T:T directives shouldn't be embedded inside HTML tags?
15:46 beatsforthemind Does anyone here have experience installing the Rest extension from here: http://git.biblibre.com/biblibre/koha-restful/ ?
15:48 beatsforthemind Or how to enable the Zebra SRU search?
15:49 drojf you have a wild range of interests
15:50 beatsforthemind I am working with an institution to pull their Koha items into a seperate website
15:53 drojf sru is documented in the koha-conf file
15:53 drojf i have not used the biblibre thingy
15:54 oleonard beatsforthemind: Why do they want to do that, if you don't mind me asking?
15:56 beatsforthemind They want to show the resources they have available on an informational website. Ideally querying Koha on tags they have added to the records.
15:58 pastebot "tcohen" at 172.16.248.212 pasted "Is this expected for now?" (17 lines) at http://paste.koha-community.org/410
16:00 bag hmm don’t think so
16:00 beatsforthemind I have the db indexed by Zebra but the Zebra SRU server is not running on port 9999
16:01 beatsforthemind Ah, I need to uncomment in koha-conf.xml ?
16:03 kidclamp bag: i get that too
16:04 bag not sure I’ll be back in like 20 minutes
16:05 gaetan_B bye
16:16 beatsforthemind Does anyone know how to form an SRU URL to get records by tag?
16:18 pianohacker beatsforthemind: you'd have to know the name of the index associated with that, no?
16:18 pianohacker *that tag
16:18 beatsforthemind I’m pretty sure I don’t have
16:19 beatsforthemind the tag I want to search indexed
16:19 beatsforthemind but I just want to search on any tag
16:20 pianohacker Zebra in particular won't let you do that, I'm fairly certain, and I think that's a limitation that extends to a lot of other search servers
16:20 pianohacker tag has to be indexed
16:21 beatsforthemind If the tag is indexed can I form a URL that will get records with a certain tag value?
16:22 pianohacker yup
16:22 pianohacker then it's just creating a CQL query for that index/value
16:23 beatsforthemind That would not be using Zebra/SRU?
16:25 bag ok back
16:25 pianohacker beatsforthemind: it would, CQL is the name of the query language
16:25 bag tcohen++
16:25 pianohacker (used by SRUσ
16:26 pianohacker (used by SRU)
16:26 bag sweet about ES=1 ;)
16:26 beatsforthemind i see
16:26 beatsforthemind This is the doc I’m finding for added a new tag index https://wiki.koha-community.org/wiki/How_to_add_new_zebra_index
16:26 bag @seen cait
16:26 huginn bag: cait was last seen in #koha 2 hours, 2 minutes, and 33 seconds ago: <cait> you are terrible.
16:26 beatsforthemind Is that correct?
16:27 drojf http://www.indexdata.com/zebra/doc/
16:27 oleonard cait left us with some parting words which will continue to apply.
17:32 beatsforthemind I’ve went the through the doc to add a tag to the Zebra index and read through quite a bit of the other documentation I haven’t really come across a good example of searching on a tag
17:33 beatsforthemind Closest example I can see it: http://localhost:9999/?version=1.1&operation=searchRetrieve&x-pquery=@attr%201=text%20@and%20plant%20soil
17:38 tcohen beatsforthemind: maybe you could share the changes you made
17:39 beatsforthemind I followed this: https://wiki.koha-community.org/wiki/How_to_add_new_zebra_index
17:40 beatsforthemind to add a new index for 945 a
17:40 beatsforthemind After that I tried myserver.com:9999/biblios?version=1.1&operation=searchRetrieve&x-pquery=@attr%2065%20=%20test&startRecord=1&maximumRecords=10&recordSchema=marcxml
17:50 tcohen Joubu: aroudn?
17:51 tcohen rangi: around?
17:55 tcohen @seen Joubu
17:55 huginn tcohen: Joubu was last seen in #koha 9 hours, 35 minutes, and 4 seconds ago: <Joubu> :)
17:55 tcohen @seen rangi
17:55 huginn tcohen: rangi was last seen in #koha 20 hours, 29 minutes, and 19 seconds ago: <rangi> id like to implement one in koha itself, fail2ban works but is a bit hardcore
17:58 tcohen kidclamp: is it expected that SearchEngine == Elasticsearch would make rebuild_zebra.pl skip indexing stuff?
17:58 tcohen do we have a wiki or a outstanding issues list somewhere
18:01 kidclamp tcohen: good question - I have assumed the cron still runs and that elastic still indexes when zebra is turned on
18:01 kidclamp but I don't know 100%
18:02 tcohen kidclamp: it should work, and I see it is broken
18:02 tcohen we are supposed to keep zebra for the z39.50 server
18:02 tcohen ah, i'm mistaken
18:03 tcohen well, no
18:03 tcohen i'm not
18:03 kidclamp expand a bit?
18:03 kidclamp :-)
18:04 tcohen they violated ModZebra instead of creating an ES variant
18:04 tcohen BUT
18:04 tcohen they are not calling the old code, so reindexing is not scheduled for Zebra
18:05 tcohen if Elasticsearch
18:05 tcohen I think the behaviour should be kept (AND vs OR)
18:05 tcohen anyway, that would be an ES bug
18:06 tcohen focus on ES-disabled
18:06 kidclamp :-)
18:06 kidclamp but note in the bug or add a known issues to wiki page
18:06 tcohen it is just that I'm used to do a touch_all_biblios.pl call for triggering reindexing
18:06 tcohen and the zebraqueue table wasn't being populated at all
18:08 kidclamp yeah, that would be unexpected, maybe just populate the table but not actually index until zebra is on
18:09 tcohen i'm not sure
18:09 tcohen i just think people will expect the Z39.50/SRU server to be up-to-date
18:09 drojf if sru and z39.50 is supposed to work with ES zebra needs to index, doesn't it?
18:09 kidclamp oh, good point
18:09 wahanui I know! The blade went right through that child!
18:10 kidclamp be back in a bit
18:10 oleonard wahanui: Who did that to you?
18:10 wahanui oleonard: i haven't a clue
18:19 tcohen anyone working on ES today?
18:23 bag I hope so
18:24 bag I know kidclamp_lunch is after lunch ;) and I’m just finishing up my lunch (gyro - gotta get ready for greece)
18:25 bag btw tcohen zebra should definitely index when ES is turned on
18:25 tcohen ok, I filled the bug
18:25 bag cool
18:26 tcohen I'm filling another one for Search.t
18:26 bag cool
18:36 magnuse kidclamp++ tcohen++ bag++
18:39 tcohen bag: how would the sign off work in this case?
18:40 tcohen should I ask Joubu or rangi to add my signature to the branch?
18:40 bag hmm.. that will take a little bit of work.
18:41 bag yeah let’s see what rangi wants to do there
18:42 tcohen also, it'd be great that the schema files and atomic update weren't broken :-D
18:43 tcohen i can help fixing it, not complaining
18:43 tcohen i just don't know what needs to be done
18:43 tcohen :-D
18:43 barton hey, I'm trying to track down an issue where one of our libraries is getting weird stuff when printing reserve slips when using SIP... and then I started thinking ... when checking items in and out through SIP, does Koha actually print the slips themselves, or is that handled by the SIP client?
18:46 pianohacker barton: oh, heh, that would almost certainly be the SIP device itself now that you mention it
18:46 pianohacker I don't think Koha prints anything directly these days, it's all browser based
18:46 barton yeah, that's what I was thinking.
18:48 tcohen well
18:48 tcohen there's that hidden feature :-P
18:50 beatsforthemind Does anyone have an example of a Zebra SRU URL that would search on a tag that is indexed by default?
18:52 tcohen beatsforthemind: you need thd-away
18:53 beatsforthemind ?
18:53 oleonard beatsforthemind: You need advice from someone who is not here, whose nick is currently "thd-away"
18:53 beatsforthemind ah, ok. thanks
18:53 magnuse i can give the sru url a try
18:55 magnuse http://site:port/biblios?version=1.1&operation=searchRetrieve&query=film&maximumRecords=10 will search some default fields, maybe all?
18:55 beatsforthemind I think just doing query=term will search everything
18:56 beatsforthemind In the returned XML there are datafields listed by tag with subfields
18:56 magnuse beatsforthemind: you want something more specific?
18:56 beatsforthemind I want to search on a specfic datafield/tag
18:57 magnuse i think this should work: http://site:port/biblios?version=1.1&operation=searchRetrieve&query=dc.title=film&maximumRecords=10
18:57 beatsforthemind Where does the dc.title come from?
18:57 magnuse query=title=film gives the same number of hits
18:57 magnuse yeah, good question
18:58 tcohen beatsforthemind: that is dublincore
18:58 beatsforthemind Looks like http://www.metatags.org/dublin_core_metadata_element_set
18:58 magnuse beatsforthemind: http://git.koha-community.org/gitweb/?p=koha.git;a=blob;f=etc/zebradb/pqf.properties;h=412cdbc336303e4bd6f0a4d0b844f80033da2c04;hb=HEAD
18:59 magnuse if i remember correctly, you can use the indexes mentioned there, and just drop the index. prefix
18:59 beatsforthemind ok, I will try adding the attr number to that and reindex
19:00 tcohen @later tell rangi i'd like to sign the ES patches, i'm just confused about the new table and the atomicupdate failing
19:00 huginn tcohen: The operation succeeded.
19:00 oleonard Bye #koha
19:02 magnuse beatsforthemind: and when it says "index.dc.creator = 1=1003" you can look in http://git.koha-community.org/gitweb/?p=koha.git;a=blob;f=etc/zebradb/biblios/etc/bib1.att;h=ff63a36c88bc3f75c4816c698be7c5eee7b39043;hb=HEAD to get a clue about what 1003 means
19:02 beatsforthemind I added the new tag I want to index and search into bib1.att
19:03 magnuse beatsforthemind: this page might be of some interest: https://wiki.koha-community.org/wiki/Making_more_indexes_searchable_with_Zebra_SRU
19:03 beatsforthemind That is a doc page I’ve seen yet :) thanks
19:04 tcohen heh
19:04 tcohen beatsforthemind: the name looks promising
19:07 magnuse that page is the result of a lot of head scratching and poking around :-)
19:13 kidclamp tcohen can you create new authorities/edit auth types? I am wondering if I flubbed something
19:21 beatsforthemind Guys
19:21 beatsforthemind I did it
19:21 beatsforthemind I’m searching on a tag using a Zebra URL
19:21 beatsforthemind thank you all for the help
19:41 cait morning kathryn :)
19:41 kathryn hi cait :)
19:43 cait kidclamp++
19:43 cait i am still looking for wnickc sometimes
19:43 kidclamp hi cait
19:45 cait how is the testing going?
19:50 kidclamp pretty good, hitting some master bugs
19:50 kidclamp tcohen filed a few bugs
19:51 cait bugsunrelated to the branch you mean?
19:51 kidclamp yup, at least I think so, can't edit authority types from a fresh db
19:53 cait hm
19:53 cait let me check on mine :)
19:54 cait hm working ok for me
19:54 cait did you change he type or field/subfield?
19:54 kidclamp are you on fresh db?
19:54 kidclamp like empty, run installer
19:54 cait no
19:55 cait what kind of error are you experiencing?
19:55 kidclamp blank page
19:55 cait but latest master for me - do you think the problem is in the data?
19:55 cait when you click where?
19:55 tcohen hi
19:55 kidclamp http://localhost:8081/cgi-bin/koha/admin/authtypes.pl
19:55 cait works fine for me
19:55 cait did you check the tables in your db?
19:55 tcohen kidclamp: adding? binding?
19:56 kidclamp auth types has values in db
19:56 cait that the mandatory data got added correctly?
19:56 cait auth_field_structure and subfield too?
19:56 kidclamp and categories.pl won't load
19:56 cait anything in the logs?
19:56 cait i am not using plack, but am on latest master
19:56 tcohen ah
19:56 cait sounds like you ran into something odd there
19:56 tcohen good catch kidclamp
19:57 cait tcohen: whatis it?
19:57 tcohen when saving a new authority record, it dies
19:57 cait looks like we are talking about 3 different things now
19:57 cait i have checked admin auth types
19:57 cait that seems ok
19:57 bag heh
19:58 kidclamp heh
19:58 cait now i am testing adding authorities :)
19:58 * bag fingers crossed
19:58 bag :)
19:59 cait ok, i am using master without plack
19:59 cait nd allworks great
20:01 rangi morning
20:01 cait morning rangi
20:01 kidclamp all works fine on my upgraded db
20:01 kidclamp droppping and trying from scratch again, on matser
20:01 cait i am kind of in doubt it's the db structure for so many different problems showing on yours
20:01 cait could it be plack/caching or something like that?
20:01 tcohen kidclamp: problem is if the DB doesn't have SearchEngine defined
20:01 cait kidclamp: also i am testing without elastic
20:02 rangi tcohen: you around? which new table?
20:02 tcohen rangi: should we fill new bugs, or send patches? or let you know?
20:02 kidclamp tochen, yeah, I hit that once, had to save 'Zebra' to fix that
20:02 rangi if it is to do with regressions, patches on the existing bug, if its anything to do with ES functionality itself new bugs please
20:03 tcohen with that, you can save new authority records
20:03 rangi basically all I want to achieve today, is that we can install/upgrade the branch .. and nothing changes (that anyone would notice)
20:03 cait i don't have ES working
20:03 tcohen ok
20:03 rangi does that make sense?
20:03 cait but i can try to help sort out what's working on normal master - if that's helpful
20:03 tcohen rangi: of course
20:03 cait just throw things at me
20:03 tcohen patch on its way
20:03 rangi thanks
20:03 rangi i can add the patches to the branch and push them up as I test them
20:03 tcohen cait: KOHA_ELASTICSEARCH=1 vagrant up
20:03 tcohen .-D
20:04 cait tcohen: didn't work last time
20:04 cait tcohen: i think maybe because my ubuntu is so old - last lts
20:04 cait planning on updating this weekend... and if that doesn't do it, we can try once i got myself a new laptop :)
20:04 tcohen you need latest ansible and vagrant (just adding their repos)
20:04 tcohen I use 14.04
20:05 tcohen rangi, this time is related to the update process (because SearchEngine is not set
20:05 cait i don't knwo hwy it didn't work when we tried, but the errors were weird and I only have an hour left tonight - i will focus on the qa queue for a bit
20:05 tcohen the quickest approach is to fallback to Zebra
20:05 kidclamp alright, that is something odd on one instance, fresh db on another working fine
20:05 tcohen cait: maybe because you are in 32 bits?
20:06 cait shouldn't be
20:06 rangi tcohen: ah yep, on the existing bug would be perfect thanks :)
20:06 cait no, i don't think so
20:08 tcohen i did my best cait :-( if i can help you, just let me know
20:08 tcohen anyway, we don't actually need ES today
20:08 cait i know, just don't want to deal with that again right now - i will try again, but after a less tirening day :)
20:09 rangi yeah we only need ES if we get to the point where we are happy to push it (ie that it breaks nothing else) then we can start testing/extending the ES stuff itself :)
20:10 tcohen kidclamp: authtypes.pl too?
20:11 kidclamp yeah, it was weird, but only one on if my devboxes, other seems fine
20:12 tcohen i think is related to SearchEngine == NULL
20:12 * tcohen tries to reproduce
20:14 tcohen rangi: suggestions on where to look for trouble?
20:15 rangi fresh install, and an upgrade are the first
20:15 tcohen the two i added are needed, i just didn't know what was the workflow today
20:15 rangi and then basically cataloguing and catalogue search
20:15 tcohen the current atomic updates break badly on the branch
20:15 rangi on the opac and staff, and then authority search on both
20:16 rangi the best thing is to have 2 koha
20:16 rangi with the same bibliographic data
20:16 rangi search on both, .. and get the same results
20:16 tcohen yeah
20:18 tcohen is there some sample bibliographic data we can use?
20:18 tcohen my records don't have the proper branch codes
20:18 tcohen or itemtypes
20:18 wahanui itemtypes are defined in administration :)
20:19 oleonard rangi, I would appreciate your opinion on Bug 16210 if you get a chance to look at it.
20:19 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16210 blocker, P5 - low, ---, jonathan.druart, Signed Off , Bug 15111 breaks the OPAC if JavaScript is disabled
20:19 cait oleonard: did you see my later? have to investigate more on the edi problem - column plugin exists
20:20 oleonard cait, yeah I don't know what to suggest next :(
20:20 cait maybe it's missing data?
20:21 cait if somoene has an idea or a quick moment to test: bug 16237
20:21 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16237 major, P5 - low, ---, koha-bugs, NEW , Adding new EDI account results in Perl error
20:21 rangi oleonard: ill put it on my list
20:21 oleonard Thanks rangi, I know you're focusing on other things today.
20:22 cait if we will get a fix in the next 3.22.x that would be good - but there is some time for that
20:24 kidclamp tcohen I have a file of about 100 records, or one of about 30k
20:24 drojf rangi: i can't index authorities in ES so it's hard to compare results
20:24 tcohen kidclamp: give the latter
20:25 drojf but i did not find any more problems when switching on zebra so far
20:26 rangi drojf: yeah for now, i was thinking compare zebra vs zebra .. one with the es branch, the other without and make sure they are the same
20:26 drojf ah yeah i got that the sedond before you wrote :)
20:26 rangi :)
20:26 drojf little sleep :)
20:26 rangi yeah, me too
20:26 * cait joins the not enough sleep group
20:28 rangi ok the branch is up to date with tcohens latest patch
20:28 rangi tcohen: you were saying the atomic updates dont work?
20:29 tcohen i got errors the last time
20:29 tcohen let me retry please
20:30 oleonard cait: I figured out how to reproduce your EDI error
20:30 kidclamp rangi http://paste.koha-community.org/411
20:30 cait oh!
20:31 rangi ahh yeah ill fix that
20:31 oleonard cait: I had plugins enabled in koha-conf.xml. After I disabled plugins the error appeared
20:31 rangi we dont need that file anymore
20:31 oleonard cait: I'll comment on the bug
20:31 rangi for the first part at least
20:31 rangi thanks kidclamp
20:31 cait oh
20:31 cait that's odd
20:31 pastebot "tcohen" at 172.16.248.212 pasted "rangi: this is what i see" (22 lines) at http://paste.koha-community.org/412
20:31 cait should it depend on that?
20:31 rangi do people want me to push direct to the branch, or attach a patch?
20:32 rangi tcohen: thanks
20:32 cait i guess would be better to display an error message at least
20:32 cait oleonard++
20:32 oleonard Since the use of a plugin appears to be optional, I wouldn't think an error would need to be shown
20:33 tcohen rangi: whatever works for you
20:33 oleonard I'll leave it up to the EDI experts.
20:33 cait makes sense - thx for tracking that down
20:33 tcohen it is pretty complete now
20:33 rangi yeah, ill probably just push these fixes to the branch and update the bug when I have
20:34 tcohen +1
20:36 bag rangi both I guess. be good to have patches on the bug and have it updated in the branch
20:37 rangi well there are currently 0 patches on the branch
20:37 rangi sorry on the bug
20:37 rangi it gets confusing to have them in both
20:37 rangi people dont know whats on the branch and try applying things twice etc
20:37 rangi so one or the other
20:38 cait could we have people attach what needs pushing to the branch and obsolete`then?
20:38 cait or is everyone pushign to a repo anyway right now?
20:38 rangi thats what I have been doing for other peoples patches
20:38 kidclamp off for now, likely back for a bit later, but haven't seen anything not reported by tcohen so far
20:38 rangi apply them test, obsolete them, and push to branch
20:39 cait makes snese to me
20:39 rangi im only talking about my patches
20:39 rangi which makes little sense to put them on the bug, when they are already on the branch :)
20:47 rangi tcohen: the branch now has fixes for those errors when installing/upgrading, if you had a chance to try it again that would be fantastic
20:48 tcohen sure
20:48 tcohen right now
20:48 wahanui hmmm... right now is testing just somebody seeing if it works?
20:53 cait rangi++ tcohen++
20:53 * tcohen now has a clean 3.20 DB to test and re-test with
20:53 tcohen heh
20:53 rangi tcohen: im going to add to the atomic update
20:54 rangi so it sets the pref to Zebra
20:54 tcohen right now?
20:54 wahanui right now is testing just somebody seeing if it works?
20:54 rangi otherwise we hit this
20:54 rangi SearchEngine system preference not set at /home/vagrant/kohaclone/opac/opac-search.pl line 41
20:54 rangi and probably in other places, so safest to make it actually set it to Zebra
20:54 tcohen ah, you are adding the usual INSERT IGNORE ...
20:54 rangi yup
20:54 tcohen makes sense
20:54 rangi should take me about 5 mins
20:55 * drojf stops building a package
20:55 rangi heh sorry drojf
20:55 drojf ah, it's ok :D
20:56 cait drojf++ too of course
20:58 rangi done, and pushed
21:00 tcohen has anyone imported a staged marc file with the indexer enabled?
21:00 tcohen it feels so gooooooood
21:00 drojf lol
21:01 tcohen reindex? no way, they are already indexed :-D
21:01 tcohen please push those patches that enable by default :-P
21:02 rangi thats the rebuild_zebra one eh?
21:02 rangi tcohen: im tesing 16249 now
21:03 tcohen rangi: yes, daemon mode, enabled on the packages
21:03 cait bug 16249
21:03 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16249 normal, P5 - low, ---, tomascohen, Needs Signoff , Zebra-specific tests should pass with ES disabled
21:03 rangi tcohen: im all for that
21:04 drojf we would need that for the OAI harvester too i guess
21:04 tcohen it is just /etc/default/koha-common USE_INDEXER_DAEMON="yes"
21:04 rangi and removing the cronjob right?
21:04 rangi commenting it out anyway
21:04 tcohen well, and a slight koha-rebuild-zebra behaviour change so the cronjob does nothing
21:05 tcohen oh bug 16190
21:05 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16190 enhancement, P5 - low, ---, tomascohen, Passed QA , Enable the indexer daemon by default
21:06 tcohen and bug 15113
21:06 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=15113 normal, P5 - low, ---, tomascohen, Passed QA , koha-rebuild-zebra should check USE_INDEXER_DAEMON and skip if enabled
21:06 rangi cool
21:06 tcohen Joubu++ !!!
21:06 rangi heh
21:07 cait Joubu++ :)
21:11 rangi ill test bug 16248 now, unles there is something else someone wants me to look at?
21:11 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16248 normal, P5 - low, ---, gmcharlt, Needs Signoff , ModZebra doesn't update zebraqueue if ES is enabled
21:11 drojf i love it when the package builder runs out of disk space 3 seconds before it would be done
21:11 rangi doh
21:12 drojf that was way worse with the old laptop that took ages to build :)
21:13 cait drojf: are you still happy with your new laptop?
21:13 drojf i am
21:13 tcohen drojf: I created a kohabuildbox...
21:14 drojf tcohen: i actually have pbuilder vps but i think it needs some love. it's supposed to build package+patch and install it too, like a sandbox but with debian packages. no time to work on that :P
21:15 tcohen hahaha
21:16 rangi oh this is an easy one to test, those are my fave
21:19 drojf ok that worked. i'll try an upgrade and an installation and go to bed
21:20 rangi thanks drojf
21:35 eythian btw at work we use a cron/daemon model that might appeal to you folks. Cron starts the process every 10 minutes, and that process processes as it needs to and then stops after 15. Locking is set so that one process may be waiting, but any more will terminate immediately. This means there's always one lying in wait.
21:35 rangi ohh thats cool
21:36 eythian So if you do an update, the changes are picked up within at most 15 minutes, and memory leaks or crashes will often just fix themselves.
21:36 eythian s/always/often/
21:37 wizzyrea ooo
21:38 eythian especially useful as we're processing gobs of data (I accidentally used 1.5 days of CPU time in one of our clusters today, in four minutes.)
21:38 eythian (doing hadoop queries)
21:39 wizzyrea Good heavens.
21:39 eythian 5,000 cores at the same time.
21:40 tcohen holy shit
21:40 wizzyrea I don't know whether to laugh or cry
21:40 bag wow
21:40 eythian because I'd forgot to add the right conditions to my "where" clause.
21:40 wizzyrea ^ see, even the pros do it
21:40 eythian amazingly, no one even noticed :)
21:40 wizzyrea not til they get the bill!
21:41 eythian nah, it's all physical servers we have
21:41 wizzyrea \o/ no harm no foul
21:41 wizzyrea also you have a cluster with 5000 cores that your company owns.
21:42 eythian 5,000 is just the max that hadoop will do at one time. I don't know how many there actually are.
21:42 wizzyrea that you could walk up to and poke if you wanted to/were allowed to
21:42 wizzyrea haha
21:42 tcohen have to leave, bye everyone, eythian, check your where clauses, it can take real days!
21:42 tcohen bye!
21:42 eythian well, I think they were in London.
21:43 eythian later :)
21:43 wizzyrea bye tcohen
21:43 rangi cya tcohen thanks for testing
21:43 wizzyrea @quote add tcohen: check your where clauses, it can take real days!
21:43 huginn wizzyrea: Error: You must be registered to use this command. If you are already registered, you must either identify (using the identify command) or add a hostmask matching your current hostmask (using the "hostmask add" command).
21:43 wizzyrea humbug.
21:43 wizzyrea @quote add tcohen: check your where clauses, it can take real days!
21:43 huginn wizzyrea: The operation succeeded. Quote #320 added.
21:50 drojf upgraded version looks good to me. no weird stuff during the upgrade, i can search biblios and authorities in opac and staff, facets seem ok, switching to ES and back to zebra did not kill it either
21:51 rangi yay!
21:51 drojf i'll purge it now and do one from scratch
21:51 rangi fabulous thanks
22:01 bag excellent
22:01 bag drojf++
22:07 cait night all :)
22:14 drojf as far as i can see it's working fine. no problems installing or afterwards
22:16 drojf [off] package is here is anyone wants to try things with it http://abunchofthings.net/koha/packages/koha-common_3.23+12478+20160412230854.6b1d1c72_all.deb
22:16 drojf i got to go to bed. good night!
22:16 wizzyrea good night!
22:16 wahanui sleep tight
22:18 rangi drojf++
22:18 wizzyrea ok, I like that response to good night.
22:19 bag nice
22:19 bag drojf++
22:42 rangi i just tried the package for a clean install, worked fine :)
22:45 bag awesome!
22:45 wahanui That'll be $1 for the awesome jar, bag
22:45 bag will do
22:59 bag @later tell cait - bug 16237 has a patch
22:59 huginn bag: The operation succeeded.
23:10 bag bug 15883
23:10 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=15883 normal, P5 - low, ---, oleonard, Signed Off , Upgrade jQuery from v1.7.2 in the staff client
23:11 bag Bugs 15126
23:11 bag bug 15126
23:11 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=15126 enhancement, P5 - low, ---, julian.maurice, Signed Off , RESTÂ API: Use newer version of Swagger2
23:12 bag bug 13903
23:12 huginn 04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=13903 enhancement, P5 - low, ---, julian.maurice, Signed Off , Add API routes to list, create, update, delete reserves
23:33 bag @later tell ashimema hey if you have a moment can you possibliy QA these two bugs? bug 15126 and 13903
23:33 huginn bag: The operation succeeded.