Time Nick Message 20:53 KevinFurst[m] Thanks for your help today 20:53 cait it's really late here so I am about to leave, but more people around in a few hours maybe 20:52 cait try without the item... try with it, try some combinations to limit it down a bit more 20:52 cait it looks fine now to me 20:52 cait you could check the logs to see if something is there 20:51 cait KevinFurst[m]: odd :( maybe try with a smaller sample to get format right first? 20:31 jalway The #2 is more of a would I break anything, if I just changed the mapping to the correct form . . . 20:30 jalway We have two issues: #1 Trouble with Importing Patrons #2 Incorrect Koha to MARC mappings. Anyone around who wouldn't mind helping me get things figured out? 20:21 KevinFurst[m] I took out the USD and moved the h to o 20:21 KevinFurst[m] =952 \$p34517200027251$aPRBE$g8.99$yBOOKS$bPRBE$o597.3 Pop pb 20:21 KevinFurst[m] Still failed. An example of what 952 looks like now 19:33 KevinFurst[m] ok good to know. I'm making changes now and will try another stage and import. 19:31 cait your FIC might work best with $2z = generic and the others with $2ddc 19:31 cait that makes Koha create a sortable form of the callnumber 19:30 cait I was wondering because of the $2 i told you about 19:30 cait ah ok 19:29 KevinFurst[m] FIC is just section + Auth name. Non fic is classified via DDC here 19:27 cait is that one of the other big classifications? 19:27 cait and you are not using DDC it looks like? 19:27 cait that would not prevent it from loading, but it would make sense to switch it 19:27 KevinFurst[m] got it. 19:27 cait or for volumes 19:27 cait $h is enumchron - used by serials to put the issue information in 19:26 cait $o is the callnumber 19:26 KevinFurst[m] is location and call number. So h or o? 19:26 cait your $h looks like it maybe is more a $o 19:25 KevinFurst[m] yep. will change now 19:25 cait you can't use the USD there 19:25 KevinFurst[m] ahh 19:25 cait it's a datatype of decimal 19:25 KevinFurst[m] right 19:25 cait that is price eh? 19:25 cait $g 19:25 cait ah yes 19:25 cait hm 19:23 KevinFurst[m] cait: I rechecked with MARC validator in MARCedit again to be sure. There were no erroneous records to remove. I added both b and y subfields with data that matched the codes in the authorized values for each. Uploaded and results came up with 23k records and 19k items which is right. Went to import and it immediately failed again. Here is an example of a 952 I'm using =952 \\$p3222200006331O$aPRBE$g5.00USD$hFIC Bya$yBOOKS$bPRBE 19:22 cait yeah, that's what most of us do 19:19 RudyHinojosa i am using mariadb, just to mention. 19:19 RudyHinojosa not seeing anything special in procedures or functions in db level. 19:15 cait ah 19:14 RudyHinojosa yeah, we have a test fund, test budget, edifact enabled, but not much further after that. test vendor. but no orders or baskets created. It was for generating a training video. 19:13 RudyHinojosa but I think this issue has been happening since inception, just never went deep dive on the issue. 19:13 wahanui i guess beta is OK 19:13 cait beta? 19:13 RudyHinojosa they both look correct. I did see a JS reference to acquisitions, which is just in beta right now. 19:09 cait the additem.tt has the PROCESS line and the link above the template code for the form 19:08 cait tempate code is here: https://git.koha-community.org/Koha-community/Koha/src/branch/23.05.x/koha-tmpl/intranet-tmpl/prog/en/includes/html_helpers.inc#L85 19:08 RudyHinojosa or pl 19:07 RudyHinojosa in the additem.tt? 19:05 cait it's probably in here: [% PROCESS subfields_for_item subfields => subfields %] 18:56 RudyHinojosa oh yeah. my bad. 18:56 cait it appears below the item form 18:54 cait that#s a drop down below hte form 18:54 cait nope 18:54 RudyHinojosa this is where the dropdown derives it's options. 18:54 RudyHinojosa </select> 18:54 cait not itemtypes 18:54 RudyHinojosa </optgroup> 18:54 cait but htat's item groups 18:54 RudyHinojosa <option value="create">Create new item group</option> 18:54 RudyHinojosa <option id="item-group-add-or-create-form-no-add" value="">Do not add to item group</option> 18:54 RudyHinojosa <optgroup label="Other options"> 18:54 RudyHinojosa </optgroup> 18:54 RudyHinojosa [% END %] 18:54 RudyHinojosa <option value="[% ig.id | html %]">[% ig.description | html %]</option> 18:54 RudyHinojosa [% FOREACH ig IN item_groups %] 18:54 RudyHinojosa <optgroup label="Use existing item group"> 18:54 RudyHinojosa <select name="item_group" id="item-group-add-or-create-form-select"> 18:53 cait it looks like the cod emight be all in additem.pl 18:53 cait i might have been thinking of the code that builds the item forms in serials/acq 18:50 cait .pl: https://git.koha-community.org/Koha-community/Koha/src/branch/23.05.x/cataloguing/additem.pl 18:50 cait Template file: https://git.koha-community.org/Koha-community/Koha/src/branch/23.05.x/koha-tmpl/intranet-tmpl/prog/en/modules/cataloguing/additem.tt 18:49 RudyHinojosa ok. 18:49 cait the older part, I was just trying to spot it for you 18:48 cait yeah, but it's a method in C4 18:48 RudyHinojosa additem.pl? 18:48 cait well say it's a bit complex 18:47 cait the code for building the item form is not super nice 18:47 RudyHinojosa I'm a seasoned 35 year developer and DBA. So i'm comfortable peeking anywhere anyone has a suggestion. 18:46 RudyHinojosa i agree, it's definitely a tail wagging the dog situation here. 18:46 cait it would be better to get to the source of the duplicates 18:46 cait well you didn#t change hte db field... but it's really just a band aid if that works 18:45 RudyHinojosa oh, then, i'm not worried. I pretty much duplicated my original administration->item types 18:45 cait I can't tell you which side effects exactly, but I expect some or many in circulation 18:45 cait and might look at the mapping to figure out things 18:45 cait and it expects valid itemtype codes 18:45 cait itemtype in items is used for all kinds of stuff 18:44 RudyHinojosa it shouldn't break things. It's allowing me to choose from a valid authorised value. I'm not doubting you, but just stating it shouldn't break things. I didn't alter the default framework. I've been using a custom framework for sometime now with no problems. 18:42 cait changing the mapping will break things 18:42 cait honestly, don't do that, if it's duplicateing, we need to fix that otherwise 18:42 cait i believe your problem might be more realted to the change 18:41 RudyHinojosa itemtypes is putting over 100 duplicate MAIN COLLECTION entries into the dropdown and the html source code proves that. My itemtypes are only 15 unique entries. So pseudo-av or not, it doesn't work. 18:37 cait for both of you.. please be super careful about changing frameworks especially in the beginning 18:37 cait same for a and b - pseudo-AV is set to branches, not found as an AV category but in administration > libraries 18:37 wahanui okay, cait. 18:37 cait it is also set to give you tons of trouble 18:37 cait and please undo that change 18:37 cait don't change the frameworks there, defualt is correct 18:37 cait they are set not in authorised values but in administration > itemtypes 18:37 cait itemtypes are a pseudo-av 18:35 cait not uqite 18:34 RudyHinojosa works fine now. 18:34 RudyHinojosa The default value "itemtypes" that doesn't exist in the table authorised_values is the culprit. The framework 952y points to this value called "itemtypes". I can't find it's source, so i can only assume it's pointing to some stored procedure to retrieve itemtypes. I had to create a new authorised value of "itemtype2" and recreate the itemtypes in here and reconfigure my custom framework 952y to point to this new authorised value. 18:33 cait so even if you got them in, they would give you some trouble 18:33 cait koha doesn't like items with missing a b and y 18:33 cait so maybe you can just copy/shift with MARCEdit 18:33 KevinFurst[m] ok. Gonna try that. 18:33 cait a and b can match, that#s no issue 18:33 cait make it mandatory again and set it in all your items 18:33 KevinFurst[m] No I wasn't aware of that. 18:33 cait definitely 18:33 cait yes 18:32 KevinFurst[m] One thing I noticed right away is that my file doesn't have a b for current library so I went in and deselected it as mandatory, leaving a home branch as both mandatory and made sure it matched correct values. Is b required no matter what? 18:32 cait and a bulkmarcimport tool 18:32 cait are you aware that there are also command line scripts for the staged marc import? 18:32 cait I am not sure about how it deals with errors, but I remember we could do a little better there 18:31 KevinFurst[m] Yes. Give me a few minutes to work through that with my file. 18:31 cait KevinFurst[m]: ^any of that make sense to you? 18:31 cait fi you are using ddc that woudl be $2ddc 18:31 cait I recommend to also add a $2 with your classification scheme - it will make Koha create a sortable form or your callnumber on import, which is used by inventory etc. - it can be done later, but it's easy that way 18:31 cait case sensitive etc. exact match on the codes 18:31 cait but basically you want a b y to match exactly what you configured in Koha (homebranch, holdingbranch and itemtype) 18:31 cait i might be able to tell you what's missing 18:31 cait do you have an example 952 you could share? 18:31 cait hm it could be the items 18:31 KevinFurst[m] If there is a bad record in there, am I correct that Koha wouldn't find it in the import/staging portion and would only find it on import? And it wouldn't just ignore that bad record, it would cause the entire job to error out? 18:30 KevinFurst[m] I have run the validate marc records tool in marc edit and then used the "Clean" file it generated as the one I try in Koha. In the "error" file MarcEdit puts the bad records into, it's like 1 or 2 records, that's it. 18:28 bag can you valid the mrc format? 18:28 wahanui i think import is what I'm trying to figure out 18:28 KevinFurst[m] import. 18:28 KevinFurst[m] Everything else seems to be ok in Koha and works. I'm using a server with 8GB of mem and it doesn't seemed pegged when I run the job. There's nothing else running on that machine. I did try a job of 10 or 11 records and it would import them but in scanning the fields between the two, I don't see anything really sticking out as materially different between the records that worked and those in the general file that fails every time on 18:28 bag KevinFurst[m]: sounds like maybe a bad record in there? 18:26 RudyHinojosa cait:resolved the 100's of repeating itemtypes in the dropdown. 18:25 cait let me get back to you in a moment 18:24 KevinFurst[m] batch, it just immediately says it fails on the job screen. I've tried breaking it down using Marc split to files of 1000 and that didn't help. I've perused the logs in CLI and don't see anything immediately popping out as the issue. 18:24 KevinFurst[m] MarcEdit to do that and then 2. I noticed that Follett exported item info using 852 instead of 952 so I had to change that. Those two changes got me a step further so that when I staged the records for import, Koha was seeing BOTH, meaning on the managed staged imports screen, it gave me values in both the # Records AND # Items columns. Previous to those changes, I only got values in # Records column. However, when I go to import the 18:24 KevinFurst[m] Awesome. So here's the bg info. We're moving from Follett Destiny to a self hosted Koha instance. I've exported all my MARC records for my two libraries and am attempting to import them into Koha. We're talking around 23k records for one library and 11k for the other (2 branches I guess if I'm to use the correct terminology.) I noticed a couple of issues right away. 1. I had to make the branch codes match up to whats in Koha so I used 18:18 cait always just ask, if someone around can help, they will :) 18:17 bag yes please 18:16 KevinFurst[m] Is it ok to post a problem I'm having with importing Marc records here? I got the recommendation from the listserv. 17:23 cait sorted = stored 17:23 Kolvir great. That's what I needed to know. 17:22 cait if you look at biblio_metadata.metadata at the sorted marcxml record, they are not there 17:22 cait either to the search engine or when using the export tool 17:22 cait they are only added when you export 17:22 cait the 952 is not part of your records 17:22 cait items work a bit different 17:21 cait ah no that won't happen 17:21 Kolvir I didn't want a mod template to interfere with the fields koha adds to 952 17:21 cait check the manual for the XSLT template setting in z39.50, we might have an existing one to do that alredy 17:21 cait the mappings won't help with it 17:21 cait you can use an XSLT template for that 17:20 Kolvir yes 17:19 cait do you mean delete all 9xx from incoming records? 17:19 cait not sure what you mean with the dropping 17:19 cait the fields in items when you add/edit an item 17:19 cait the fields in biblio, biblioitems and filled/updated when you update/add a bibliographic record 17:17 Kolvir koha to marc I mean 17:17 Kolvir are the koha to mark mapping done after any record being modified by a template when it is saved? What I want to do is drop all 900 fields that come from say a z39.50 search when they are imported. 17:15 Kolvir ok 17:14 cait maybe have a look at those columsn in the items table sometime, it should be more easy to understand then 17:13 cait had them the wrong way 17:13 cait hm from cn_source (classification type) in cn_sort (sortable form) 17:13 Kolvir Ok, thank you! 17:13 cait so good to have that set up correctly :) 17:12 cait or when sorting tables on callnumber 17:12 cait this is used for invnetory 17:12 cait and then koha creates a sorting form of your itemcallnumber from cn_sort in cn_source 17:12 cait the itemcallnumber is put in items.itemcallnumber 17:12 Kolvir had to move to a new computer 17:12 Kolvir cataloging starts this week 17:12 cait ah, so what happens is when you catalog: 17:12 Kolvir 50-60 17:12 cait oh that's good then :) 17:11 Kolvir no 17:11 Kolvir that's how it was already set 17:11 cait do you have a lof ot items already? 17:11 cait so now you are set up for any new items 17:11 Kolvir ok 17:10 cait then set the DefaultClassificationSource system preference also to ddc 17:10 Kolvir ok 17:10 cait c 17:10 cait so in classification sources, make the "in use" only yes for dd 17:10 cait ok 17:10 Kolvir yes 17:10 cait are you only using ddc? 17:09 cait one moment 17:09 Kolvir I've got 082a in the itemcallnumber system preference, but am not seeing where/how to set up $2 cn_source with ddc . I'm looking at Administration -> Classification Configuration 17:04 cait it will help you get proper sorting for your callnumbers 17:04 cait also make sure to set up $2 cn_source with ddc (administration > classification sources) 17:03 cait it can help you with cataloguing, it will show the 082a if you add a new item, helping you with filling the callnumber in the item 17:03 cait have a look at the itemcallnumber system preference 17:02 cait yes, don't do that 17:02 Kolvir I was trying to get the DDC call number from 082a displayed in the holdings table instead of the one that shows up, they don't match exactly 16:58 cait :) 16:57 Kolvir That was it, thank you. 16:48 Kolvir ok, will check that 16:47 cait check the koha-to-marc mappings 16:47 cait maybe you have an items field mapped to a field that is not a 952? 16:42 Kolvir yes 16:40 RudyHinojosa Kolvir->do you have everything in the 952 tag and subfields pointing to the 10 tab? 16:38 Kolvir I've dug through the 952 field and compared it to the default framework, but can't see any differences 16:37 Kolvir I can not find this error from the MARC bibliographic framework test. Can someone please giveme some ideas on how to track it down? ALL items fields MUST : be mapped to the same tag, and they must all be in the 10 (items) tab 15:53 eythian tcohen: https://gitlab.com/koha-community/docker/koha-docker/-/issues/19 I found the cause of your issue with docker swarm 15:41 oleonard Using a slightly older version of my test data clears it up but I sure wish I knew what it was about. 15:35 cait very odd 15:35 oleonard The links on circulation home page 15:35 cait where are you not seeing them? 15:34 oleonard it must be some kind of data problem because it works with the sample data 15:34 cait and turned it on too? 15:29 oleonard I'm having a weird permissions issue today... I can't see Recalls stuff even though I'm logged in as a superlibrarian 15:28 cait but some more days of vacation at least 15:28 cait me neither 15:28 oleonard No more touring for me... 15:23 cait i guess most devs still touring Finland - so not many people around here today 15:22 RudyHinojosa chrome has the same slow behaviour as well on the dropdown. firefox does not have this issue. 15:16 RudyHinojosa i'll try on a windows machine shortly. 15:16 RudyHinojosa I'm on the latest on Pop-Os 15:14 cait can you confirm the newer version fixes it? 15:09 RudyHinojosa https://answers.microsoft.com/en-us/microsoftedge/forum/all/edge-lags-freezes-on-website-dropdown-menus/5c7262e8-b20a-466c-ac93-6569138807a9 15:08 cait that sounds hard to catch 15:07 RudyHinojosa I've seen echoes of dropdown data in coding projects that turned out to be a video driver issue. 15:07 cait you could try filing a report for the duplication at least - maybe someone else has seen it or an idea 15:06 cait I am quickly running out of ideas here 15:06 cait very odd indeed 15:06 RudyHinojosa everything is almost instant. 15:06 RudyHinojosa yes, but at least there is no performance hit. 15:05 RudyHinojosa lol 15:05 RudyHinojosa microsoft is your friend. let us in! 15:05 cait but didn't you say it also duplicated in firefox? 15:05 cait I am not sure I am willing to go there... 15:05 RudyHinojosa edge is available on linux 15:05 cait I can't - on Linux 15:05 cait very similar to mine 15:05 RudyHinojosa using edge? 15:04 RudyHinojosa my item type 15:03 RudyHinojosa https://drive.lightwavelibrary.com/d/s/uv7y6qSNO4MNueWoe2OgFQvzYC94bjS9/LdBkfI1_M-SQ3lZLM_qDc_-E2o9jlpoW-XbHAuG-LsQo 15:03 cait hm still behaving nicely 15:02 cait I'll try to limit them to some libraries 15:02 cait hm in master sample data the itemtypes are ok 15:01 RudyHinojosa yes. 15:01 cait only once in itemtypes I assume? 15:01 RudyHinojosa yeup. 15:01 RudyHinojosa https://drive.lightwavelibrary.com/d/s/uv6scWDaK14TmaQso0WFmDCF0Ip7twFT/73b2Oh1wCEzUBAQ0UZzi4zWF9VAYIqDJ-0LAAIvmHsQo 15:01 cait that's a whole lot of main collection 15:00 RudyHinojosa the main collection 15:00 RudyHinojosa peek at my screenshot. it appears several times. 14:59 cait but it's showing up twice, not 3 times? 14:59 RudyHinojosa no groups 14:59 cait library groups also? 14:59 cait ok so there is a library limitation going on 14:58 RudyHinojosa ok, I need to tell you that my client is using a consortium and sharing the itemtype across 3 other libraries. 14:58 RudyHinojosa I'm going to check advanced settings on edge and see if I can find some clues. 14:57 cait if you give me 5 mins I can get my development up and check there at least for the duplication 14:57 cait I am German so haven't come across that yet 14:57 cait oh! 14:57 RudyHinojosa lol 14:57 RudyHinojosa 13 14:57 cait is a baker's dozen more? 14:56 RudyHinojosa I knew I hated microsoft for dozens of reasons, now it's for a bakers dozen reasons. ;) 14:56 cait I don't have edge to give it a try 14:56 cait super strange 14:53 RudyHinojosa but it's fast. 14:53 RudyHinojosa uh oh. firefox does not have a problem. but the item types are still duplicated. 14:52 RudyHinojosa going to try a different browser. was using edge. 14:51 RudyHinojosa onclick 14:51 RudyHinojosa something goofy happening on the dropdown onstart routine. 14:46 RudyHinojosa >cait: no effect. now I haven't restarted the server either after removing the codeblock. may not be required. 14:43 RudyHinojosa cait: i'll do that right now. thank you. be right back w/ the verdict. 14:42 cait just ruling it out as a source of the issue 14:42 cait just to make sure, I'd try to remove it and try again 14:42 RudyHinojosa >aroussos: sql report came back instant. 14:40 RudyHinojosa screen shot of only js in intranet block. I'm using the batch permissions plugin. 14:39 RudyHinojosa https://drive.lightwavelibrary.com/d/s/uv75hrTJKAEzydcIqRSy1EgRUwPSkTzC/sII0kvJC01adFxqsft1syEMC5HDLBi3U-DbGgoqWIsQo 14:38 aroussos RudyHinojosa: OK then, the next thing I would do is create a very simple SQL report from within Koha (something along the lines of 'SELECT * FROM itemtypes') and run that to see if it returns quickly or hangs for 15-30 seconds 14:36 RudyHinojosa checking for JS interference in code blocks. 14:36 RudyHinojosa no. mariadb is on the same server local 14:34 aroussos RudyHinojosa: any chance your MariaDB database is located on a host external to the system that hosts Koha? 14:33 RudyHinojosa screen shot of duplicate item types 14:33 RudyHinojosa https://drive.lightwavelibrary.com/d/s/uv6scWDaK14TmaQso0WFmDCF0Ip7twFT/73b2Oh1wCEzUBAQ0UZzi4zWF9VAYIqDJ-0LAAIvmHsQo 14:33 cait also if you can have a look at the logs server side 14:33 cait anything in the console? maybe some JS interfering? 14:33 cait that sounds all types of wrong 14:32 RudyHinojosa just one. I am seeing a long wait time when triggering the drop down for item types. also seeing item type duplications in the dropdown. but they are not duplicated in admin item types. 14:32 cait it's not 'normal' - it should be much quicker 14:31 cait RudyHinojosa: I am not sure, do you have many items on that record? 14:24 RudyHinojosa Current Config 14:24 RudyHinojosa https://drive.lightwavelibrary.com/d/s/uv6XOOUc0SS2QVf5fIv2bVZy2SyDjL6a/HSYkZBR0mTo6His9oXcbEtkrDrwiOj1f-k7Dgzt-GsQo 14:16 RudyHinojosa optimized. 14:16 RudyHinojosa using Mariadb 14:15 RudyHinojosa What could be causing the edit of an item to hang the interface for about 15-30 seconds? v23.05.02 11:52 PriyanshuSoni[m] Hey guys,... (full message at <https://matrix.org/_matrix/media/v3/download/matrix.org/UYgPCqJDwfkseFMvfvscMbmH>) 11:05 Zahid[m] 👍️cait oleonard Anneli Österman 10:58 Zahid[m] thanks i got your point. my issue is resolved. 10:52 * cait nods 10:51 cait depending on the type you selected for a patron category, the name fields will display a little differently in the patron edit form 10:51 oleonard Zahid[m]: It's the same data, stored in the same place. It's just displayed differently based on the patron category 10:49 Zahid[m] what is mean by organization identity vs patron identity ? how can i differentiate ? and on what fields koha separates these two identity? 10:30 cait \o 10:28 oleonard o/ 10:07 cait hello 10:00 Annelisterman[m] Organizational patrons do not have first name. You can save/import it to the borrowers table but if you add organizational patron via staff interface it is not possible to add firstname. Also it is not shown on patron details page if there is one. Could that be the reason? 09:01 Zahid[m] any suggestions ? am i missing some thing? 09:00 Zahid[m] the first name of some patrons are display correctly but some patron's firstname is not display 08:57 Zahid[m] about 60000 patrons are imported successfully but when i see in koha the firstname of patron is not display on opening records, it searches correctly 08:55 Zahid[m] i am using koha 22.11 version i have imported all my patrons data into Koha 22.11 08:54 Zahid[m] hi every one, need help in patrons 07:55 aw-bib[m] hello :) I'd have a small more bibliographic question. our catalouge currently holds a number of "not so common" ids. eg. pointers to inspirehep, arXiv in some cases even wos. I'd not want to loose them and at some later point in time even use them like we do now for uplinking to those sources. how do I preserve them in koha properly? 04:25 PriyanshuSoni[m] * public mode, still nothing is showing in crousel config. 04:25 PriyanshuSoni[m] <rudyh> "Confirm that the item type you..." <- Yes, i have created a list of Books in public mode.