Time  Nick            Message
00:45 oleonard        Hi "night" shift
00:46 pianohacker     wow, you're here late.
00:47 oleonard        Isn't this late for you too pianohacker?
00:47 pianohacker     well, yes...
00:48 oleonard        Is there a formal plan for ES testing tomorrow?
00:50 pianohacker     I do not think so, beyond what Brendan posted
01:13 oleonard        Hi dcook
01:13 dcook           heya oleonard :)
01:14 oleonard        Thanks for your nice words on my Bootstrap bug
01:14 dcook           No worries. You are awesome ^_^.
01:15 oleonard        I managed to do a lot of yak-shaving today related to that
01:15 dcook           I know in the past I expressed some reserve at moving to v3 as well, so I wanted to clarify that I've reversed that opinion.
01:15 dcook           Oh yeah?
01:15 oleonard        I know you've dealt with more recalcitrant users than most :)
01:15 dcook           I think the users are often receptive, but their IT departments are not :(
01:16 dcook           I heard a story about one department that only got to use Chrome after the whole ministry updated their website but it wouldn't work on the version of IE that was mandated for the ministry
01:16 dcook           I would've loved to be there at that Monday morning panic...
01:17 oleonard        Bug 16241 and Bug 16242 (not to mention Bug 15883) are all steps towards a Bootstrap upgrade in the staff client
01:17 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16241 enhancement, P5 - low, ---, oleonard, Needs Signoff , Move staff client CSS out of language directory
01:17 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16242 enhancement, P5 - low, ---, oleonard, Needs Signoff , Move staff client JavaScript out of language directory
01:17 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=15883 normal, P5 - low, ---, oleonard, Needs Signoff , Upgrade jQuery from v1.7.2 in the staff client
01:18 oleonard        ...because I think we'll have to make our own build of Bootstrap if we want to do an incremental upgrade (not converting the templates 100%)
01:20 dcook           I hope it's not too difficult :(
01:20 dcook           Btw, excited about the jQuery upgrade
01:21 oleonard        It's a pain, but it's worth it.
01:21 oleonard        Anyway, everyone sign off on all of those bugs and good night! I'll be back in 10.5 hours!
01:21 dcook           oleonard++
01:25 dcook           I wonder if we could make stubs for templates and .pl scripts...
02:26 wizzyrea        @wunder nzwn
02:26 huginn          wizzyrea: The current temperature in Wellington, New Zealand is 20.0°C (2:00 PM NZST on April 12, 2016). Conditions: Mostly Cloudy. Humidity: 73%. Dew Point: 15.0°C. Pressure: 29.83 in 1010 hPa (Steady).
02:26 wizzyrea        20!
02:26 wizzyrea        shocking.
03:43 mtj_            hey wiz++, thanks muchly for your patch on 13216  :0)
03:47 wizzyrea        oh, I'm just glad it was kinda sorta useful.
03:47 wizzyrea        it could go much much further
04:05 mtj_            yeah, its a fiddly thing to 'fix'
04:18 mtj_            but... i have now have a general plan that should work well - fingers xrossed
04:21 wizzyrea        \o/
05:26 drojf           morning
05:33 dcook           morning drojf
05:33 dcook           And blarg for non-persistent environments...
05:33 dcook           Maybe I should be using the new REST API... although I know nothing about it or if it's even a thing now...
05:33 drojf           hi dcook
05:37 dcook           Oh I forgot that fredericd left me with a nice Koha::OAI::Client namespace... huzzah
06:13 drojf           @later tell rangi is libcatmandu-store-elasticsearch-perl the only catmandu module we use that is not in jessie?
06:13 huginn          drojf: The operation succeeded.
06:15 * magnuse       waves
06:21 drojf           hei magnuse
06:25 * drojf         runs off to the catmandu workshop
06:50 reiveune        hello
06:50 wahanui         privet, reiveune
07:15 dcook           I wonder if we're translating the whole error string when using C4::Biblio::DelBiblio...
07:19 gaetan_B        hello
07:19 alex_a          Bonjour
07:27 * magnuse       waves again
07:29 * cait          waves
07:30 * dcook         waves and heads home
07:42 magnuse         drojf: have fun with catmandu!
07:44 drojf           magnuse: i will :)
07:44 drojf           as far as i can follow the discussions :)
07:51 drojf           did anyone set up koha+ES lately and can tell me if the deb files in the archive are needed or only the unpacked deb files? http://debian.koha-community.org/koha/otherthings/
07:53 magnuse         cait has been installing Koha+ES, i think?
07:54 drojf           i think she gave up due to an outdated os?
07:54 magnuse         ah, maybe
07:54 * magnuse       is also stuck on 14.04
07:55 drojf           fwiw i do not seem to have libelasticsearch-searchbuilder-perl or libsearch-elasticsearch-compat-perl on my ES test vm, so i'd say only the unpacked deb files are needed
07:56 drojf           magnuse: i can share my VM if you want to try it
07:56 drojf           but i think there will be a test machine by bywater too
07:58 magnuse         thanks, but no time at the moment
07:59 drojf           more play, less work ;)
08:03 magnuse         yes please :-)
08:03 * magnuse       has a raspberry pi 3 model b sitting on a shelf
08:12 pastebot        "teachcolby" at pasted "ILL Module" (1 line) at http://paste.koha-community.org/407
08:14 drojf           magnuse: did you install koha on it?
08:14 drojf           i did not buy a 3 so far. but i would love to see how 3.22.5 with plack compares to 3.22.0
08:15 drojf           that's a funny paste
08:16 * teachcolby    slaps drojf around a bit with a large fishbot
08:18 pastebot        "teachcolby" at pasted "ILL Module" (2 lines) at http://paste.koha-community.org/408
08:20 drojf           teachcolby: i guess you are in the webchat? there should be a field to enter text somewhere?
08:20 Joubu           :)
08:23 gaetan_B        has anyone tried Koha Ubuntu 16.04 yet ? (Xenial Xerus, the new LTS)
08:23 pastebot        "teachcolby" at pasted "I'm using a paste it function" (1 line) at http://paste.koha-community.org/409
08:25 drojf           teachcolby: the easy version would be to use the actual chat. there should be a test field at the very bottom of the page?
08:25 drojf           anyway there is work being done on an ILL module, see https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=7317
08:25 huginn          04Bug 7317: new feature, P5 - low, ---, alex.sassmannshausen, NEW , Add an Interlibrary Loan Module to Circulation and OPAC
09:16 cait            magnuse: cait tried but got stuck on her os - will update my ubuntu this weekend after backup :)
09:49 magnuse         cait: ah, gotcha
10:02 magnuse         drojf: i didn't even power it on yet :-)
10:02 magnuse         lunchtime!
10:02 wahanui         lunchtime is a terrible time for a meeting
10:02 magnuse         yup
10:56 drojf           i have some data missing fields. like 100 and 245. i really hope that was faulty test data and nothing that happened because of ES
11:19 cait            drojf++
11:50 oleonard        Hi #koha
11:53 oleonard        is there a guide to getting Elastic Search set up locally for testing, or is it better to use someone else's test server?
12:04 kidclamp        oleonard: https://wiki.koha-community.org/wiki/Elasticsearch
12:18 oleonard        Good morning, my fellow Americans.
12:22 nengard         good morning!
12:22 wahanui         the only good morning is a dead one
12:22 nengard         um
12:22 nengard         that's sad
12:22 nengard         heh
12:23 oleonard        wahanui: Don't worry we're killin' this morning
12:23 wahanui         oleonard: sorry...
12:39 * magnuse       waves to the americans
12:41 oleonard        I can't see how authorised value images are displayed in the OPAC at all with XSLT turned on.
12:42 oleonard        The preference doesn't have any effect on the advanced search page, which always displays images for ccode.
12:46 drojf           ha, my problem seems to be that there is auth data stored as biblios. i did not even know that is possible, i must have screwed that up myself
12:54 cait            oleonard: i think that's what Joubu said somewhere too - non-functional for xslt
12:55 cait            but proably still slowing us down
12:56 oleonard        I'm commenting on the bug... I think we need to remove both preferences altogether.
12:56 oleonard        I don't see a purpose for them.
12:56 magnuse         off with their heads!
12:56 magnuse         @wunder boo
12:56 huginn          magnuse: The current temperature in Bodo, Norway is 4.0°C (2:50 PM CEST on April 12, 2016). Conditions: Mostly Cloudy. Humidity: 75%. Dew Point: 0.0°C. Windchill: -1.0°C. Pressure: 29.98 in 1015 hPa (Steady).
12:56 magnuse         snowing, akshuly
12:57 oleonard        @wunder 45701
12:57 huginn          oleonard: The current temperature in Heatherstone, Athens, Ohio is 6.1°C (8:57 AM EDT on April 12, 2016). Conditions: Clear. Humidity: 58%. Dew Point: -2.0°C. Windchill: 6.0°C. Pressure: 30.25 in 1024 hPa (Rising).  Freeze warning in effect from 2 am to 9 am EDT Wednesday... 
12:57 cait            oleonard:  i think having icons for location and maybe lost values... or restricted values
12:57 cait            coudl be nice... but i think on the result lsit it's not necessary
12:57 cait            if at all i'd limit it to the detail view
12:58 oleonard        cait: Could be nice, but Koha doesn't do it
12:58 cait            ah
12:58 cait            i thought detail was functional
12:58 oleonard        Not with XSLT on as far as I can tell.
12:58 cait            so we only keep the option for adv search?
12:58 cait            we have a library using htat
12:58 cait            for locations
12:59 oleonard        the adv search page shows the images no matter what. It doesn't check any pref
12:59 cait            cool
12:59 cait            and Joubu is not remoing the add an icon to the auth values I hope - so that should be fine
13:01 oleonard        Oh, duh.
13:01 oleonard        Bug 16167
13:01 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16167 enhancement, P5 - low, ---, jonathan.druart, Needs Signoff , Authorised value images may be removed
13:01 oleonard        Then why Bug 16041?!
13:01 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16041 normal, P5 - low, ---, jonathan.druart, Needs Signoff , StaffAuthorisedValueImages & AuthorisedValueImages preferences - impact on search performace
13:01 oleonard        *sigh*
13:04 oleonard        Oh, bug 16041 removes the option to show images altogether... so no more images on the adv search page :(
13:40 jajm            oleonard, bug 16154 applies well for me, are you sure you applied the patches on current master ?
13:40 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16154 normal, P5 - low, ---, jonathan.druart, Patch doesn't apply , Replace CGI->param with CGI->multi_param in list context
13:40 oleonard        I thought I was sure jajm, but I will try again
13:40 cait            oleonard: going a bit too far then
13:41 cait            oleonard: we just added images for locations for a library...
13:41 oleonard        cait: Shelving location?
13:41 wahanui         rumour has it Shelving location is now in italic underneath the library name
13:41 cait            yeah
13:41 cait            for adv search page obviously...
13:42 cait            as i didn't know it would not work for detail then :)
13:43 oleonard        If you had asked me before today I would have said they definitely did work on the detail page.
13:43 oleonard        I don't know what version I'm remembering.
13:51 tcohen          hi everyone
13:51 tcohen          sorry i'm late
13:51 tcohen          :D
13:53 cait            oleonard: I thought i read in joubus summary that it should work...
13:53 cait            so we are 2 people
13:53 cait            oh
13:53 cait            one sec
13:54 cait            hm it was turned off
13:54 cait            but turning it on didn't work
14:07 tcohen          hi cait
14:08 tcohen          kidclamp: did u succeed with kohadevbox and es
14:09 kidclamp        as of right now, yes!
14:09 kidclamp        but not with 2.x
14:09 kidclamp        1.7.5
14:10 tcohen          how is that?
14:10 tcohen          http://snag.gy/uXZH2.jpg
14:10 tcohen          KOHA_ELASTICSEARCH=1 vagrant provision
14:11 tcohen          should end up with 2.x
14:11 drojf           tcohen: catmandu and ES 2 are not friends yet. i wrote something yesterday about it
14:11 tcohen          ah!
14:11 tcohen          ok
14:11 kidclamp        yes, but 2.x doesn't work, so I had to do manual
14:11 tcohen          i will patch it right now
14:11 cait            drojf: around?
14:11 kidclamp        I also needed libcatmandu-marc-perl
14:11 drojf           kind of
14:12 kidclamp        drojf++
14:12 cait            tuesday before hackfest - there are no plans yet, are they?
14:12 cait            are there...
14:12 cait            maybe dinner?
14:12 cait            or helping you set up something?
14:12 drojf           apart from arranging the room, getting drinks and stuff i think no
14:13 drojf           i thought we could have dinner before rangi falls into a coma
14:13 drojf           somewhere close to his hotel
14:13 drojf           are you staying there btw?
14:13 cait            yep
14:13 cait            seemed like a good idea
14:14 drojf           yeah i think its a good option, i wante dto put it in the wiki
14:14 drojf           we should have made a deal with them
14:14 drojf           ;)
14:14 cait            and i like sticking together in groups somehow :)
14:14 cait            although i am a little afraid people will think i am helpful because i speak german
14:15 drojf           how can that be helpful? :D
14:15 cait            no idea
14:15 magnuse         so i understand what subscription.lastvalue1 and subscription.lastvalue2 does, but what does innerloop1 do?
14:15 drojf           german is not spoken much in neukölln :D
14:15 cait            the position in the loop i think
14:16 cait            magnuse: lastvalue = starting point
14:16 magnuse         so it's related to periodicity?
14:16 cait            hm let me see
14:16 oleonard        cait: You're doing a terrible job convincing everyone you're not helpful.
14:17 cait            lastvalue = when it jumps over i think
14:17 cait            innerloop = current position
14:17 magnuse         nah, lastvalue is the last value that was generated, i think?
14:17 cait            well it can differe
14:18 cait            it's the inner counter
14:18 cait            say your last value is 2015
14:18 cait            or 2016
14:18 magnuse         so if the last issue was "2016 No. 2" lastevalue1 will be 2016 and lastvalue2 will be 2?
14:18 cait            inner counter probably 1
14:18 cait            let me find a screenshot
14:20 magnuse         kia ora JesseM_away
14:20 JesseM          hi magnuse
14:20 tcohen          kidclamp: libcatmandu-marc-perl from cpan?
14:21 cait            magnuse: sorry, only finding old serials examples... still looking
14:21 drojf           cait: we can set some time on tuesday to meet at the office and prepare some things if you want to plan that 6 weeks ahead :)
14:22 cait            drojf: the problem is i have to plan - giving training the same day :)
14:22 drojf           i thought you are on holiday :P
14:23 cait            plans change
14:23 drojf           tsk
14:23 drojf           so when is the training?
14:23 cait            tuesday morning
14:23 cait            possibly some of the afternoon
14:23 cait            so that's why I was asking
14:23 cait            :)
14:23 drojf           possibly? how can you not know? don't you plan things?
14:23 * drojf         hides
14:24 cait            you are terrible.
14:24 drojf           sorry :)
14:24 drojf           i sleept veery little the last days and should go to bed
14:24 drojf           slept
14:24 kidclamp        tcohen: No!!!! from debian cpan breaks it
14:25 kidclamp        from debian. cpan breaks it
14:25 kidclamp        what I was struggling with for forever
14:27 tcohen          ok, kohadevbox patched
14:29 magnuse         tcohen++
14:30 tcohen          ES?
14:30 wahanui         ES is pretty awesome
14:30 tcohen          ES?
14:30 wahanui         ES is pretty awesome
14:31 tcohen          is there a wiki for toda?
14:31 tcohen          y
14:32 kidclamp        https://wiki.koha-community.org/wiki/Elasticsearch
14:32 kidclamp        for install
14:33 kidclamp        for testing the focus is really on ensuring that all zebra functionality continues if ES is installed
14:38 magnuse         playing dungeons 'n dragons in the middle of the workday, eh?
14:41 tcohen          kidclamp: so we also need to install teh debs on otherthings?
14:42 kidclamp        yes, I think only the ones not packaged
14:42 kidclamp        sorry not archived
14:42 kidclamp        ignore the tar.gz
14:43 oleonard        jajm: I tried Bug 16154 again with the same results. "fatal: sha1 information is lacking or useless (admin/patron-attr-types.pl)"
14:43 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16154 normal, P5 - low, ---, jonathan.druart, Patch doesn't apply , Replace CGI->param with CGI->multi_param in list context
14:53 oleonard        mveron++
15:05 jajm            oleonard, ok it's weird
15:07 tcohen          kidclamp: http://snag.gy/YizhW.jpg
15:09 beatsforthemind Hello Koha people
15:10 kidclamp        did oyu just update?
15:10 kidclamp        tcohen^
15:11 tcohen          i run
15:11 tcohen          KOHA_ELASTICSEARCH=1 vagrant provision
15:11 tcohen          so it re-provisions the VM
15:11 kidclamp        Ah, you just added install of those deps to kohadevbox
15:11 tcohen          yeap
15:11 kidclamp        I was testing a clean run :-)
15:12 kidclamp        can the koha-conf.xml update be added?
15:12 tcohen          i changed to ES 1.7, and added the deps (from jessie, and ours)
15:12 tcohen          kidclamp: I think so ;-)
15:12 tcohen          I mean, sure!
15:13 tcohen          what should the index_name be?
15:13 tcohen          is that the instance name?
15:13 reiveune        bye
15:13 kidclamp        koha_kohadev
15:13 kidclamp        yup
15:13 tcohen          ok
15:13 tcohen          will do right now
15:13 kidclamp        tcohen++
15:14 kidclamp        I also have to change the permission on koha-conf each time
15:14 tcohen          why is that?
15:14 tcohen          the koha-conf file is created by koha-create
15:15 kidclamp        I don't know, but I always get Couldn't open /etc/koha/sites/kohadev/koha-conf.xml:
15:15 kidclamp        Permission denied at /usr/share/perl5/XML/SAX/Expat.pm line 75.
15:15 kidclamp        BEGIN failed--compilation aborted at misc/search_tools/rebuild_elastic_search.pl line 86.
15:15 kidclamp        sudo chmod 755 .... and all works
15:16 tcohen          kidclamp: maybe you are not running it inside koha-shell kohadev?
15:16 kidclamp        I am not,  I realized that too
15:17 kidclamp        it's a whole extra command that way :-)
15:17 tcohen          kidclamp: I usually run byobu
15:17 tcohen          and have several tabs on it
15:18 tcohen          one for the koha-shell, one for logs, etc
15:19 kidclamp        tcohen:I do tabs, but am lazy and want to do everything without koha-shell - I will pay my permissons price
15:19 tcohen          hahaha
15:20 eythian         kidclamp: the downside is that now you've opened up a password-containing file to be world readable.
15:20 eythian         this is why we have things like koha-shell
15:21 kidclamp        you are certainly correct eythian, I treat my kohadevbox poorly
15:21 drojf           koha's hell
15:21 eythian         yeah, devbox is OK, but then you keep the bad habits in production :)
15:23 kidclamp        kidclamp--
15:23 huginn          kidclamp: Error: You're not allowed to adjust your own karma.
15:23 kidclamp        I will try to be better
15:23 drojf           eythian: do you remember if we needed liblog-any-perl_1.03-1_all.deb or just liblog-any-perl in general? 0.15 is in jessie and i wonder if that is enough for koha+ES
15:24 eythian         not sure
15:24 eythian         try it and see if it works :)
15:27 tcohen          we should really test in a similar env to that in production
15:30 drojf           tcohen: i wanted to try a package installation like a user would do, but i am probably not going to do that today
15:32 tcohen          <elasticsearch>
15:32 tcohen          <server>localhost:9200</server>
15:32 tcohen          <index_name>koha_{{ koha_instance_name }}</index_name>
15:32 tcohen          </elasticsearch>
15:32 tcohen          oops
15:39 oleonard        Isn't it still the case that T:T directives shouldn't be embedded inside HTML tags?
15:46 beatsforthemind Does anyone here have experience installing the Rest extension from here: http://git.biblibre.com/biblibre/koha-restful/ ?
15:48 beatsforthemind Or how to enable the Zebra SRU search?
15:49 drojf           you have a wild range of interests
15:50 beatsforthemind I am working with an institution to pull their Koha items into a seperate website
15:53 drojf           sru is documented in the koha-conf file
15:53 drojf           i have not used the biblibre thingy
15:54 oleonard        beatsforthemind: Why do they want to do that, if you don't mind me asking?
15:56 beatsforthemind They want to show the resources they have available on an informational website. Ideally querying Koha on tags they have added to the records.
15:58 pastebot        "tcohen" at pasted "Is this expected for now?" (17 lines) at http://paste.koha-community.org/410
16:00 bag             hmm don’t think so
16:00 beatsforthemind I have the db indexed by Zebra but the Zebra SRU server is not running on port 9999
16:01 beatsforthemind Ah, I need to uncomment in koha-conf.xml ?
16:03 kidclamp        bag: i get that too
16:04 bag             not sure I’ll be back in like 20 minutes
16:05 gaetan_B        bye
16:16 beatsforthemind Does anyone know how to form an SRU URL to get records by tag?
16:18 pianohacker     beatsforthemind: you'd have to know the name of the index associated with that, no?
16:18 pianohacker     *that tag
16:18 beatsforthemind I’m pretty sure I don’t have
16:19 beatsforthemind the tag I want to search indexed
16:19 beatsforthemind but I just want to search on any tag
16:20 pianohacker     Zebra in particular won't let you do that, I'm fairly certain, and I think that's a limitation that extends to a lot of other search servers
16:20 pianohacker     tag has to be indexed
16:21 beatsforthemind If the tag is indexed can I form a URL that will get records with a certain tag value?
16:22 pianohacker     yup
16:22 pianohacker     then it's just creating a CQL query for that index/value
16:23 beatsforthemind That would not be using Zebra/SRU?
16:25 bag             ok back
16:25 pianohacker     beatsforthemind: it would, CQL is the name of the query language
16:25 bag             tcohen++
16:25 pianohacker     (used by SRUσ
16:26 pianohacker     (used by SRU)
16:26 bag             sweet about ES=1 ;)
16:26 beatsforthemind i see
16:26 beatsforthemind This is the doc I’m finding for added a new tag index https://wiki.koha-community.org/wiki/How_to_add_new_zebra_index
16:26 bag             @seen cait
16:26 huginn          bag: cait was last seen in #koha 2 hours, 2 minutes, and 33 seconds ago: <cait> you are terrible.
16:26 beatsforthemind Is that correct?
16:27 drojf           http://www.indexdata.com/zebra/doc/
16:27 oleonard        cait left us with some parting words which will continue to apply.
17:32 beatsforthemind I’ve went the through the doc to add a tag to the Zebra index and read through quite a bit of the other documentation I haven’t really come across a good example of searching on a tag
17:33 beatsforthemind Closest example I can see it: http://localhost:9999/?version=1.1&operation=searchRetrieve&x-pquery=@attr%201=text%20@and%20plant%20soil
17:38 tcohen          beatsforthemind: maybe you could share the changes you made
17:39 beatsforthemind I followed this: https://wiki.koha-community.org/wiki/How_to_add_new_zebra_index
17:40 beatsforthemind to add a new index for 945 a
17:40 beatsforthemind After that I tried myserver.com:9999/biblios?version=1.1&operation=searchRetrieve&x-pquery=@attr%2065%20=%20test&startRecord=1&maximumRecords=10&recordSchema=marcxml
17:50 tcohen          Joubu: aroudn?
17:51 tcohen          rangi: around?
17:55 tcohen          @seen Joubu
17:55 huginn          tcohen: Joubu was last seen in #koha 9 hours, 35 minutes, and 4 seconds ago: <Joubu> :)
17:55 tcohen          @seen rangi
17:55 huginn          tcohen: rangi was last seen in #koha 20 hours, 29 minutes, and 19 seconds ago: <rangi> id like to implement one in koha itself, fail2ban works but is a bit hardcore
17:58 tcohen          kidclamp: is it expected that SearchEngine == Elasticsearch would make rebuild_zebra.pl skip indexing stuff?
17:58 tcohen          do we have a wiki or a outstanding issues list somewhere
18:01 kidclamp        tcohen: good question - I have assumed the cron still runs and that elastic still indexes when zebra is turned on
18:01 kidclamp        but I don't know 100%
18:02 tcohen          kidclamp: it should work, and I see it is broken
18:02 tcohen          we are supposed to keep zebra for the z39.50 server
18:02 tcohen          ah, i'm mistaken
18:03 tcohen          well, no
18:03 tcohen          i'm not
18:03 kidclamp        expand a bit?
18:03 kidclamp        :-)
18:04 tcohen          they violated ModZebra instead of creating an ES variant
18:04 tcohen          BUT
18:04 tcohen          they are not calling the old code, so reindexing is not scheduled for Zebra
18:05 tcohen          if Elasticsearch
18:05 tcohen          I think the behaviour should be kept (AND vs OR)
18:05 tcohen          anyway, that would be an ES bug
18:06 tcohen          focus on ES-disabled
18:06 kidclamp        :-)
18:06 kidclamp        but note in the bug or add a known issues to wiki page
18:06 tcohen          it is just that I'm used to do a touch_all_biblios.pl call for triggering reindexing
18:06 tcohen          and the zebraqueue table wasn't being populated at all
18:08 kidclamp        yeah, that would be unexpected, maybe just populate the table but not actually index until zebra is on
18:09 tcohen          i'm not sure
18:09 tcohen          i just think people will expect the Z39.50/SRU server to be up-to-date
18:09 drojf           if sru and z39.50 is supposed to work with ES zebra needs to index, doesn't it?
18:09 kidclamp        oh, good point
18:09 wahanui         I know! The blade went right through that child!
18:10 kidclamp        be back in a bit
18:10 oleonard        wahanui: Who did that to you?
18:10 wahanui         oleonard: i haven't a clue
18:19 tcohen          anyone working on ES today?
18:23 bag             I hope so
18:24 bag             I know kidclamp_lunch is after lunch ;)  and I’m just finishing up my lunch (gyro - gotta get ready for greece)
18:25 bag             btw tcohen zebra should definitely index when ES is turned on
18:25 tcohen          ok, I filled the bug
18:25 bag             cool
18:26 tcohen          I'm filling another one for Search.t
18:26 bag             cool
18:36 magnuse         kidclamp++ tcohen++ bag++
18:39 tcohen          bag: how would the sign off work in this case?
18:40 tcohen          should I ask Joubu or rangi to add my signature to the branch?
18:40 bag             hmm.. that will take a little bit of work.
18:41 bag             yeah let’s see what rangi wants to do there
18:42 tcohen          also, it'd be great that the schema files and atomic update weren't broken :-D
18:43 tcohen          i can help fixing it, not complaining
18:43 tcohen          i just don't know what needs to be done
18:43 tcohen          :-D
18:43 barton          hey, I'm trying to track down an issue where one of our libraries is getting weird stuff when printing reserve slips when using SIP... and then I started thinking ... when checking items in and out through SIP, does Koha actually print the slips themselves, or is that handled by the SIP client?
18:46 pianohacker     barton: oh, heh, that would almost certainly be the SIP device itself now that you mention it
18:46 pianohacker     I don't think Koha prints anything directly these days, it's all browser based
18:46 barton          yeah, that's what I was thinking.
18:48 tcohen          well
18:48 tcohen          there's that hidden feature :-P
18:50 beatsforthemind Does anyone have an example of a Zebra SRU URL that would search on a tag that is indexed by default?
18:52 tcohen          beatsforthemind: you need thd-away
18:53 beatsforthemind ?
18:53 oleonard        beatsforthemind: You need advice from someone who is not here, whose nick is currently "thd-away"
18:53 beatsforthemind ah, ok. thanks
18:53 magnuse         i can give the sru url a try
18:55 magnuse         http://site:port/biblios?version=1.1&operation=searchRetrieve&query=film&maximumRecords=10 will search some default fields, maybe all?
18:55 beatsforthemind I think just doing query=term will search everything
18:56 beatsforthemind In the returned XML there are datafields listed by tag with subfields
18:56 magnuse         beatsforthemind: you want something more specific?
18:56 beatsforthemind I want to search on a specfic datafield/tag
18:57 magnuse         i think this should work: http://site:port/biblios?version=1.1&operation=searchRetrieve&query=dc.title=film&maximumRecords=10
18:57 beatsforthemind Where does the dc.title come from?
18:57 magnuse         query=title=film gives the same number of hits
18:57 magnuse         yeah, good question
18:58 tcohen          beatsforthemind: that is dublincore
18:58 beatsforthemind Looks like http://www.metatags.org/dublin_core_metadata_element_set
18:58 magnuse         beatsforthemind: http://git.koha-community.org/gitweb/?p=koha.git;a=blob;f=etc/zebradb/pqf.properties;h=412cdbc336303e4bd6f0a4d0b844f80033da2c04;hb=HEAD
18:59 magnuse         if i remember correctly, you can use the indexes mentioned there, and just drop the index. prefix
18:59 beatsforthemind ok, I will try adding the attr number to that and reindex
19:00 tcohen          @later tell rangi i'd like to sign the ES patches, i'm just confused about the new table and the atomicupdate failing
19:00 huginn          tcohen: The operation succeeded.
19:00 oleonard        Bye #koha
19:02 magnuse         beatsforthemind: and when it says "index.dc.creator            = 1=1003" you can look in http://git.koha-community.org/gitweb/?p=koha.git;a=blob;f=etc/zebradb/biblios/etc/bib1.att;h=ff63a36c88bc3f75c4816c698be7c5eee7b39043;hb=HEAD to get a clue about what 1003 means
19:02 beatsforthemind I added the new tag I want to index and search into bib1.att
19:03 magnuse         beatsforthemind: this page might be of some interest: https://wiki.koha-community.org/wiki/Making_more_indexes_searchable_with_Zebra_SRU
19:03 beatsforthemind That is a doc page I’ve seen yet :) thanks
19:04 tcohen          heh
19:04 tcohen          beatsforthemind: the name looks promising
19:07 magnuse         that page is the result of a lot of head scratching and poking around :-)
19:13 kidclamp        tcohen can you create new authorities/edit auth types? I am wondering if I flubbed something
19:21 beatsforthemind Guys
19:21 beatsforthemind I did it
19:21 beatsforthemind I’m searching on a tag using a Zebra URL
19:21 beatsforthemind thank you all for the help
19:41 cait            morning kathryn :)
19:41 kathryn         hi cait :)
19:43 cait            kidclamp++
19:43 cait            i am still looking for wnickc sometimes
19:43 kidclamp        hi cait
19:45 cait            how is the testing going?
19:50 kidclamp        pretty good, hitting some master bugs
19:50 kidclamp        tcohen filed a few bugs
19:51 cait            bugsunrelated to the branch you mean?
19:51 kidclamp        yup, at least I think so, can't edit authority types from a fresh db
19:53 cait            hm
19:53 cait            let me check on mine :)
19:54 cait            hm working ok for me
19:54 cait            did you change he type or field/subfield?
19:54 kidclamp        are you on fresh db?
19:54 kidclamp        like empty, run installer
19:54 cait            no
19:55 cait            what kind of error are you experiencing?
19:55 kidclamp        blank page
19:55 cait            but latest master for me - do you think the problem is in the data?
19:55 cait            when you click where?
19:55 tcohen          hi
19:55 kidclamp        http://localhost:8081/cgi-bin/koha/admin/authtypes.pl
19:55 cait            works fine for me
19:55 cait            did you check the tables in your db?
19:55 tcohen          kidclamp: adding? binding?
19:56 kidclamp        auth types has values in db
19:56 cait            that the mandatory data got added correctly?
19:56 cait            auth_field_structure and subfield too?
19:56 kidclamp        and categories.pl won't load
19:56 cait            anything in the logs?
19:56 cait            i am not using plack, but am on latest master
19:56 tcohen          ah
19:56 cait            sounds like you ran into something odd there
19:56 tcohen          good catch kidclamp
19:57 cait            tcohen: whatis it?
19:57 tcohen          when saving a new authority record, it dies
19:57 cait            looks like we are talking about 3 different things now
19:57 cait            i have checked admin auth types
19:57 cait            that seems ok
19:57 bag             heh
19:58 kidclamp        heh
19:58 cait            now i am testing adding authorities :)
19:58 * bag           fingers crossed
19:58 bag             :)
19:59 cait            ok, i am using master without plack
19:59 cait            nd allworks great
20:01 rangi           morning
20:01 cait            morning rangi
20:01 kidclamp        all works fine on my upgraded db
20:01 kidclamp        droppping and trying from scratch again, on matser
20:01 cait            i am kind of in doubt it's the db structure for so many different problems showing on yours
20:01 cait            could it be plack/caching or something like that?
20:01 tcohen          kidclamp: problem is if the DB doesn't have SearchEngine defined
20:01 cait            kidclamp: also i am testing without elastic
20:02 rangi           tcohen: you around? which new table?
20:02 tcohen          rangi: should we fill new bugs, or send patches? or let you know?
20:02 kidclamp        tochen, yeah, I hit that once, had to save 'Zebra' to fix that
20:02 rangi           if it is to do with regressions, patches on the existing bug, if its anything to do with ES functionality itself new bugs please
20:03 tcohen          with that, you can save new authority records
20:03 rangi           basically all I want to achieve today, is that we can install/upgrade the branch .. and nothing changes (that anyone would notice)
20:03 cait            i don't have ES working
20:03 tcohen          ok
20:03 rangi           does that make sense?
20:03 cait            but i can try to help sort out what's working on normal master - if that's helpful
20:03 tcohen          rangi: of course
20:03 cait            just throw things at me
20:03 tcohen          patch on its way
20:03 rangi           thanks
20:03 rangi           i can add the patches to the branch and push them up as I test them
20:03 tcohen          cait: KOHA_ELASTICSEARCH=1 vagrant up
20:03 tcohen          .-D
20:04 cait            tcohen: didn't work last time
20:04 cait            tcohen: i think maybe because my ubuntu is so old - last lts
20:04 cait            planning on updating this weekend... and if that doesn't do it, we can try once i got myself a new laptop :)
20:04 tcohen          you need latest ansible and vagrant (just adding their repos)
20:04 tcohen          I use 14.04
20:05 tcohen          rangi, this time is related to the update process (because SearchEngine is not set
20:05 cait            i don't knwo hwy it didn't work when we tried, but the errors were weird and I only have an hour left tonight - i will focus on the qa queue for a bit
20:05 tcohen          the quickest approach is to fallback to Zebra
20:05 kidclamp        alright, that is something odd on one instance, fresh db on another working fine
20:05 tcohen          cait: maybe because you are in 32 bits?
20:06 cait            shouldn't be
20:06 rangi           tcohen: ah yep, on the existing bug would be perfect thanks :)
20:06 cait            no, i don't think so
20:08 tcohen          i did my best cait :-( if i can help you, just let me know
20:08 tcohen          anyway, we don't actually need ES today
20:08 cait            i know, just don't want to deal with that again right now  - i will try again, but after a less tirening day :)
20:09 rangi           yeah we only need ES if we get to the point where we are happy to push it (ie that it breaks nothing else) then we can start testing/extending the ES stuff itself :)
20:10 tcohen          kidclamp: authtypes.pl too?
20:11 kidclamp        yeah, it was weird, but only one on if my devboxes, other seems fine
20:12 tcohen          i think is related to SearchEngine == NULL
20:12 * tcohen        tries to reproduce
20:14 tcohen          rangi: suggestions on where to look for trouble?
20:15 rangi           fresh install, and an upgrade are the first
20:15 tcohen          the two i added are needed, i just didn't know what was the workflow today
20:15 rangi           and then basically cataloguing and catalogue search
20:15 tcohen          the current atomic updates break badly on the branch
20:15 rangi           on the opac and staff, and then authority search on both
20:16 rangi           the best thing is to have 2 koha
20:16 rangi           with the same bibliographic data
20:16 rangi           search on both, .. and get the same results
20:16 tcohen          yeah
20:18 tcohen          is there some sample bibliographic data we can use?
20:18 tcohen          my records don't have the proper branch codes
20:18 tcohen          or itemtypes
20:18 wahanui         itemtypes are defined in administration :)
20:19 oleonard        rangi, I would appreciate your opinion on Bug 16210 if you get a chance to look at it.
20:19 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16210 blocker, P5 - low, ---, jonathan.druart, Signed Off , Bug 15111 breaks the OPAC if JavaScript is disabled
20:19 cait            oleonard: did you see my later? have to investigate more on the edi problem - column plugin exists
20:20 oleonard        cait, yeah I don't know what to suggest next :(
20:20 cait            maybe it's missing data?
20:21 cait            if somoene has an idea or a quick moment to test: bug 16237
20:21 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16237 major, P5 - low, ---, koha-bugs, NEW , Adding new EDI account results in Perl error
20:21 rangi           oleonard: ill put it on my list
20:21 oleonard        Thanks rangi, I know you're focusing on other things today.
20:22 cait            if we will get a fix in the next 3.22.x that would be good - but there is some time for that
20:24 kidclamp        tcohen I have a file of about 100 records, or one of about 30k
20:24 drojf           rangi: i can't index authorities in ES so it's hard to compare results
20:24 tcohen          kidclamp: give the latter
20:25 drojf           but i did not find any more problems when switching on zebra so far
20:26 rangi           drojf: yeah for now, i was thinking compare zebra vs zebra .. one with the es branch, the other without and make sure they are the same
20:26 drojf           ah yeah i got that the sedond before you wrote :)
20:26 rangi           :)
20:26 drojf           little sleep :)
20:26 rangi           yeah, me too
20:26 * cait          joins the not enough sleep group
20:28 rangi           ok the branch is up to date with tcohens latest patch
20:28 rangi           tcohen: you were saying the atomic updates dont work?
20:29 tcohen          i got errors the last time
20:29 tcohen          let me retry please
20:30 oleonard        cait: I figured out how to reproduce your EDI error
20:30 kidclamp        rangi http://paste.koha-community.org/411
20:30 cait            oh!
20:31 rangi           ahh yeah ill fix that
20:31 oleonard        cait: I had plugins enabled in koha-conf.xml. After I disabled plugins the error appeared
20:31 rangi           we dont need that file anymore
20:31 oleonard        cait: I'll comment on the bug
20:31 rangi           for the first part at least
20:31 rangi           thanks kidclamp
20:31 cait            oh
20:31 cait            that's odd
20:31 pastebot        "tcohen" at pasted "rangi: this is what i see" (22 lines) at http://paste.koha-community.org/412
20:31 cait            should it depend on that?
20:31 rangi           do people want me to push direct to the branch, or attach a patch?
20:32 rangi           tcohen: thanks
20:32 cait            i guess would be better to display an error message at least
20:32 cait            oleonard++
20:32 oleonard        Since the use of a plugin appears to be optional, I wouldn't think an error would need to be shown
20:33 tcohen          rangi: whatever works for you
20:33 oleonard        I'll leave it up to the EDI experts.
20:33 cait            makes sense - thx for tracking that down
20:33 tcohen          it is pretty complete now
20:33 rangi           yeah, ill probably just push these fixes to the branch and update the bug when I have
20:34 tcohen          +1
20:36 bag             rangi both I guess.  be good to have patches on the bug and have it updated in the branch
20:37 rangi           well there are currently 0 patches on the branch
20:37 rangi           sorry on the bug
20:37 rangi           it gets confusing to have them in both
20:37 rangi           people dont know whats on the branch and try applying things twice etc
20:37 rangi           so one or the other
20:38 cait            could we  have people attach what needs pushing to the branch and obsolete`then?
20:38 cait            or is everyone pushign to a repo anyway right now?
20:38 rangi           thats what I have been doing for other peoples patches
20:38 kidclamp        off for now, likely back for a bit later, but haven't seen anything not reported by tcohen so far
20:38 rangi           apply them test, obsolete them, and push to branch
20:39 cait            makes snese to me
20:39 rangi           im only talking about my patches
20:39 rangi           which makes little sense to put them on the bug, when they are already on the branch :)
20:47 rangi           tcohen: the branch now has fixes for those errors when installing/upgrading, if you had a chance to try it again that would be fantastic
20:48 tcohen          sure
20:48 tcohen          right now
20:48 wahanui         hmmm... right now is testing just somebody seeing if it works?
20:53 cait            rangi++ tcohen++
20:53 * tcohen        now has a clean 3.20 DB to test and re-test with
20:53 tcohen          heh
20:53 rangi           tcohen: im going to add to the atomic update
20:54 rangi           so it sets the pref to Zebra
20:54 tcohen          right now?
20:54 wahanui         right now is testing just somebody seeing if it works?
20:54 rangi           otherwise we hit this
20:54 rangi           SearchEngine system preference not set at /home/vagrant/kohaclone/opac/opac-search.pl line 41
20:54 rangi           and probably in other places, so safest to make it actually set it to Zebra
20:54 tcohen          ah, you are adding the usual INSERT IGNORE ...
20:54 rangi           yup
20:54 tcohen          makes sense
20:54 rangi           should take me about 5 mins
20:55 * drojf         stops building a package
20:55 rangi           heh sorry drojf
20:55 drojf           ah, it's ok :D
20:56 cait            drojf++ too of course
20:58 rangi           done, and pushed
21:00 tcohen          has anyone imported a staged marc file with the indexer enabled?
21:00 tcohen          it feels so gooooooood
21:00 drojf           lol
21:01 tcohen          reindex? no way, they are already indexed :-D
21:01 tcohen          please push those patches that enable by default :-P
21:02 rangi           thats the rebuild_zebra one eh?
21:02 rangi           tcohen: im tesing 16249 now
21:03 tcohen          rangi: yes, daemon mode, enabled on the packages
21:03 cait            bug 16249
21:03 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16249 normal, P5 - low, ---, tomascohen, Needs Signoff , Zebra-specific tests should pass with ES disabled
21:03 rangi           tcohen: im all for that
21:04 drojf           we would need that for the OAI harvester too i guess
21:04 tcohen          it is just /etc/default/koha-common USE_INDEXER_DAEMON="yes"
21:04 rangi           and removing the cronjob right?
21:04 rangi           commenting it out anyway
21:04 tcohen          well, and a slight koha-rebuild-zebra behaviour change so the cronjob does nothing
21:05 tcohen          oh bug 16190
21:05 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16190 enhancement, P5 - low, ---, tomascohen, Passed QA , Enable the indexer daemon by default
21:06 tcohen          and bug 15113
21:06 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=15113 normal, P5 - low, ---, tomascohen, Passed QA , koha-rebuild-zebra should check USE_INDEXER_DAEMON and skip if enabled
21:06 rangi           cool
21:06 tcohen          Joubu++ !!!
21:06 rangi           heh
21:07 cait            Joubu++ :)
21:11 rangi           ill test bug 16248 now, unles there is something else someone wants me to look at?
21:11 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16248 normal, P5 - low, ---, gmcharlt, Needs Signoff , ModZebra doesn't update zebraqueue if ES is enabled
21:11 drojf           i love it when the package builder runs out of disk space 3 seconds before it would be done
21:11 rangi           doh
21:12 drojf           that was way worse with the old laptop that took ages to build :)
21:13 cait            drojf: are you still happy with your new laptop?
21:13 drojf           i am
21:13 tcohen          drojf: I created a kohabuildbox...
21:14 drojf           tcohen: i actually have pbuilder vps but i think it needs some love. it's supposed to build package+patch and install it too, like a sandbox but with debian packages. no time to work on that :P
21:15 tcohen          hahaha
21:16 rangi           oh this is an easy one to test, those are my fave
21:19 drojf           ok that worked. i'll try an upgrade and an installation and go to bed
21:20 rangi           thanks drojf
21:35 eythian         btw at work we use a cron/daemon model that might appeal to you folks. Cron starts the process every 10 minutes, and that process processes as it needs to and then stops after 15. Locking is set so that one process may be waiting, but any more will terminate immediately. This means there's always one lying in wait.
21:35 rangi           ohh thats cool
21:36 eythian         So if you do an update, the changes are picked up within at most 15 minutes, and memory leaks or crashes will often just fix themselves.
21:36 eythian         s/always/often/
21:37 wizzyrea        ooo
21:38 eythian         especially useful as we're processing gobs of data (I accidentally used 1.5 days of CPU time in one of our clusters today, in four minutes.)
21:38 eythian         (doing hadoop queries)
21:39 wizzyrea        Good heavens.
21:39 eythian         5,000 cores at the same time.
21:40 tcohen          holy shit
21:40 wizzyrea        I don't know whether to laugh or cry
21:40 bag             wow
21:40 eythian         because I'd forgot to add the right conditions to my "where" clause.
21:40 wizzyrea        ^ see, even the pros do it
21:40 eythian         amazingly, no one even noticed :)
21:40 wizzyrea        not til they get the bill!
21:41 eythian         nah, it's all physical servers we have
21:41 wizzyrea        \o/ no harm no foul
21:41 wizzyrea        also you have a cluster with 5000 cores that your company owns.
21:42 eythian         5,000 is just the max that hadoop will do at one time. I don't know how many there actually are.
21:42 wizzyrea        that you could walk up to and poke if you wanted to/were allowed to
21:42 wizzyrea        haha
21:42 tcohen          have to leave, bye everyone, eythian, check your where clauses, it can take real days!
21:42 tcohen          bye!
21:42 eythian         well, I think they were in London.
21:43 eythian         later :)
21:43 wizzyrea        bye tcohen
21:43 rangi           cya tcohen thanks for testing
21:43 wizzyrea        @quote add tcohen: check your where clauses, it can take real days!
21:43 huginn          wizzyrea: Error: You must be registered to use this command. If you are already registered, you must either identify (using the identify command) or add a hostmask matching your current hostmask (using the "hostmask add" command).
21:43 wizzyrea        humbug.
21:43 wizzyrea        @quote add tcohen: check your where clauses, it can take real days!
21:43 huginn          wizzyrea: The operation succeeded.  Quote #320 added.
21:50 drojf           upgraded version looks good to me. no weird stuff during the upgrade, i can search biblios and authorities in opac and staff, facets seem ok, switching to ES and back to zebra did not kill it either
21:51 rangi           yay!
21:51 drojf           i'll purge it now and do one from scratch
21:51 rangi           fabulous thanks
22:01 bag             excellent
22:01 bag             drojf++
22:07 cait            night all :)
22:14 drojf           as far as i can see it's working fine. no problems installing or afterwards
22:16 drojf           [off] package is here is anyone wants to try things with it http://abunchofthings.net/koha/packages/koha-common_3.23+12478+20160412230854.6b1d1c72_all.deb
22:16 drojf           i got to go to bed. good night!
22:16 wizzyrea        good night!
22:16 wahanui         sleep tight
22:18 rangi           drojf++
22:18 wizzyrea        ok, I like that response to good night.
22:19 bag             nice
22:19 bag             drojf++
22:42 rangi           i just tried the package for a clean install, worked fine :)
22:45 bag             awesome!
22:45 wahanui         That'll be $1 for the awesome jar, bag
22:45 bag             will do
22:59 bag             @later tell cait - bug 16237 has a patch
22:59 huginn          bag: The operation succeeded.
23:10 bag             bug 15883
23:10 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=15883 normal, P5 - low, ---, oleonard, Signed Off , Upgrade jQuery from v1.7.2 in the staff client
23:11 bag             Bugs 15126
23:11 bag             bug 15126
23:11 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=15126 enhancement, P5 - low, ---, julian.maurice, Signed Off , REST API: Use newer version of Swagger2
23:12 bag             bug 13903
23:12 huginn          04Bug http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=13903 enhancement, P5 - low, ---, julian.maurice, Signed Off , Add API routes to list, create, update, delete reserves
23:33 bag             @later tell ashimema hey if you have a moment can you possibliy QA these two bugs?  bug 15126 and 13903
23:33 huginn          bag: The operation succeeded.