Time  Nick  Message
04:46 thd   kados: this was merely a bibliographic framework issue
04:25 thd   kados: search authors '...' for jack lewis
04:25 thd   kados: yay it works
04:24 thd   I had started to do that a few hours ago and then distracted myself
04:23 thd   I fixed author searching of authorities in the OPAC
02:33 thd   good night kados
02:20 thd   kados: ISearch had a companion component ISite that was the backend and not part of the gateway where ISearch connects to other backends.
02:17 thd   kados: you woke up too early this afternoon :)
02:16 thd   you can still see Isearch doing some of what it had done at http://www.loc.gov/z3950/
02:14 thd   s/that/year 2000/
02:12 thd   kados: prior to that most of their systems at LC were in house systems except cataloguing which is an MSDOS program made by someone whom I have spoken with who has an office in New York.
02:10 thd   kados: Also there were special LC modifications to ISearch so that it did what they wanted.  Those modifications were not part of the public domain distribution.
02:09 thd   kados: Zebra does much more than ISearch ever imagined.
02:08 thd   kados: If Zebra did not exist Isearch would be work looking at but I have no C background.
02:05 kados heh
02:05 thd   kados: It was designed for MARC records.
02:05 thd   kados: I was going to use Isearch long ago until I discovered why LC abandoned it.
02:04 kados interesting
02:03 thd   CNIDR was an agency set up by the library of congress to create this for them.  They also were involved with the creation of WAIS if you remember that.
02:01 thd   http://www.cnidr.org/ is probably outdated but if you google for Isearch you can find the German company that maintained a very expensive commercial version which fixed the Unicode and other problems
01:59 thd   "the ISearch-CGI public domain software that is available from CNIDR. It should be noted that many search and retrieval capabilities that are available in the Z39.50 protocol are not implemented in this gateway. The Initialization, Search, and Retrieval facilities have been implemented."
01:55 thd   kados: yes I will find the link
01:55 kados it was open source?
01:54 thd   kados: before 2000 LC ran much of their own software.  Their catalog was mostly open source but it did not do Unicode.
01:53 thd   kados: voyager like other OPACs is configurable or customisable.  catalog.loc.gov looked much the same before they ever outsourced it.
01:51 thd   catalog is voyager but authorities could be an in house or contract job.
01:50 thd   catalog.loc.gov also does not force left anchoring
01:50 kados thd: that stephen thinks is so great?
01:50 kados thd: is this voyager?
01:50 thd   kados: the links that you cannot click on in authorities.loc.gov can be clicked in catalog.loc.gov
01:49 thd   kados: Bible could be in a 610 perhaps as well as a 650 it is too fundamental too know
01:47 thd   610 corporate name subject, etc.
01:47 thd   kados: 600 is a subject based on a personal name
01:46 kados only it picks different parts of them out for display
01:46 thd   kados: it is difficult to find the authorised forms because searches are left anchored
01:46 kados but it seems that with LOC no matter what search you do you get the same auth files back
01:45 kados same with a Subject Search
01:45 thd   s/subjects/used as subjects/
01:45 kados i koha's current scheme, if you do a 'NAME search you will not get 'TITLE entries back
01:45 thd   kados: names can also be subjects
01:44 kados that seems like too much of a coincidence
01:44 thd   kados: those are not the authority record if they cannot be clicked
01:44 kados same with NAME
01:44 kados same with title
01:43 kados there are also 25 subjct headings for Bible
01:43 kados thd: none of them can be clicked on
01:43 kados thd: for 'Bible' the LOC authorities only has 25 entries in NAME/TITLE
01:42 thd   kados: uniform tile covers more than just 130 and 830 in the biblio also but I have not checked all the places
01:41 thd   kados: yes they are not common and I had not checked
01:40 kados $c hamlet
01:40 thd   kados: you check the value of 130 in the authority record against 130 and 830 in the biblio
01:40 kados 100 $a Shakespheare,
01:40 kados thd: I think the above example would be written:
01:39 kados and if there is, it is a NAME/TITLE
01:39 kados is it safe to say that we can check to see if there is an author listed along with a title
01:39 thd   kados: 130 $aShakespeare/Hamlet  would be different form 130 $aFerraro/Hamlet
01:39 kados so if we're importing
01:38 thd   kados: name/tiltle is a special kind of Uniform tilte
01:37 thd   kados: they are the same
01:37 kados is there a difference between a uniform title and a uniform title heading?
01:37 thd   kados: Uniform titles are for distinguishing the work or the expression across different editions
01:37 kados can it?
01:37 kados a name/title authority can't _be_ a uniform title
01:36 kados they are different things
01:36 kados _as a uniform title_?
01:36 thd   then you would have a name/title authority as a uniform title
01:35 kados but I thought a uniform title was only used when a title was not associated with a specific author, like the bible
01:35 thd   kados: the clever librarian could have made 130 $aFerraro, Joshua Mxxx / World improvement or however that would be done
01:33 thd   kados: the French will have 245 $aImprovement monde or whatever that would be in French$cby( i should know the French for that) kados.
01:31 thd   kadso: the clever librarian creates a uniform title in 130 $aWorld improvement
01:30 thd   kados: some clever librarian wants to catalogue the French edition
01:30 thd   kados: the main author will be controlled 100 $aFerraro, joshua Mxxx$d19XX-
01:28 thd   kados: that book will have 245 $aWorld improvement$cby kados.
01:27 thd   and that is how it is printed on the title page.
01:27 thd   kados: You wrote a fine book World Improvement by kados
01:26 thd   kados: a good system would be full of 130s in bibliographic records which are rare in the real world.
01:25 thd   kados: 245 has what is printed on the title page just as it appears.
01:25 kados shouldn't a good system have full authority control where relevant?
01:25 kados why not?
01:25 thd   kados: 245 is not controlled.
01:24 thd   kados: The authority has the contents of the 130 match that or try to match to 130 in the biblo and any place else that might be relevant in case I overlook something.
01:24 kados and you can't map both TITLE and NAME/TITLE to 245a
01:23 kados you can't map both NAME and NAME/TITLE too 100a
01:23 kados one, we can only map one thesaurus value to a given subfield
01:22 kados for several reasons
01:22 thd   kados: why not?
01:22 kados if I'm not mistaken
01:22 kados we can only deal with them independently
01:22 kados I don't think we can currently handle name/titles
01:21 thd   kados: if the uniform title authority is in name /title form like Shakespeare/hamlet then it its a name title heading.
01:20 thd   kados: name/title headings are possible uniform title records.
01:20 kados why would you want a name/title heading instead of separate title and name headings?
01:20 kados I don't understand why there exist name headings, title headings and name/title headings
01:19 thd   kados: I was talking about matching authority record content to biblio content by adding a $9 to a match in the biblio.
01:18 thd   kados: the biblio will have the fields it has unless you are asking about how to catalogue a particular work
01:17 kados I thought we were talking about auth records ...
01:17 thd   kados: the biblio will already have a name / title unless you are creating original records.
01:15 thd   yes
01:15 kados thd: you still there?
01:15 kados under what circumstances on import do I create a NAME/TITLE heading instead of a NAME or a TITLE heading or should I always create all three?
01:13 kados or none of them?
01:13 kados or only some of them?
01:13 kados are all TITLES and NAMES also in NAME/TITLE headings?
01:12 kados what is the difference between NAME/TITLE HEADINGS and UNIFORM TITLES? :-)
01:06 thd   the series uniform title would be an 830 in the bibliographic record not 130 which would be for the individual volume if there were a uniform title for the individual volume.
00:58 thd   so every volume of the Education through Art series has the same uniform title.
00:57 thd   kados: uniform title is also used for series such as Education through Art
00:54 thd   kados: then LibLime Newsletter would become a 530
00:54 thd   kados: When it is transformed into the LibLime Journal of Information Science it may change 130 but then so would the older bibliographic entry for the record where 245 has LibLime newsletter
00:51 thd   kados: LibLime Newsletter could also be a uniform tile
00:50 thd   kados: then it would also serve as a name/title heading
00:49 thd   kados: Shakespeare/Hamlet could be a uniform title
00:49 kados and UNIFORM TITLES?
00:49 kados what is the difference between NAME/TITLE HEADINGS
00:48 kados er?
00:48 thd   kados: those are in uniform titles
00:47 kados how do we handle NAME/TITLE HEADINGS?
00:47 thd   yes
00:46 kados terms are subjects?
00:46 thd   kados: looks good to me
00:44 kados do those map?
00:44 kados X55 	Genre/form terms
00:44 kados X51 	Geographic names
00:44 kados X50 	Topical terms
00:44 kados X48 	Chronological terms
00:44 kados X30 	Uniform titles
00:44 kados X11 	Meeting names
00:44 kados X10 	Corporate names
00:44 kados X00  	Personal names
00:41 kados NAME, SUBJECT, NAME / TITLE HEADING, UNIFORM TITLE
00:41 kados so how do we break things down into our framework codes?
00:32 thd   kados: beyond that bulkauthimport,pl has no utility for creating a working model.
00:31 thd   s/field/local use field/
00:31 thd   kados: after that point his intention of labelling the type more explicitly in a single field may be useful.
00:30 kados right
00:30 thd   kados: authority type is determined from the 1XX used.
00:29 thd   kados: paul imagined that the leader also contained a clue about authority type but it does not.
00:29 kados I think we already know which are auth records
00:29 kados I'm not sure that's the way to go about it
00:28 thd   kados: that can be determined from the leader.
00:28 thd   kados: first you must test for whether you have an authority record or a bibliographic record.
00:26 thd   kados: paul's vague intention with bulkauthimport.pl is obvious and that can be seen from the code.
00:15 kados build_authorities.pl and bulkauthimport.pl
00:14 thd   kados: both which scripts?
00:14 kados AUTHaddauthority
00:14 kados both scripts use the same subroutine
00:13 thd   kados: If you understand how build_authorities.pl works then you can add authority supporting code to a copy of bulkmarcimport.pl to create a working bulkauthimport.pl.
00:12 thd   kados: the code to study is build_authorities.pl and bulkmarcimport.pl
00:11 kados gotcha
00:11 thd   kados: you cannot learn much that is correct from that code.
00:10 thd   kados: That code was a couple hours start that was abandoned before he had anything right
00:10 kados all it does is call AUTHaddauthority
00:10 kados it looks like it might work
00:10 kados why do you say it is do nothing?
00:09 kados why does paul use it in bulkauthimport.pl?
00:09 thd   kados: were you looking at the do nothing code in bulkauthimport.pl?
00:09 thd   kados: leader position 000/09 is undefined in UNIMARC for both bibliographic and authorities.
00:03 thd   s/framework/biblio framework/
00:01 thd   kados: It is not a true authorities search
00:00 thd   kados: it does not seem to search tracings and references in the authority but that would only need the proper support of a framework column for that
23:55 thd   kados: the '...' search gives you a different results display that you can use to refine your search
23:54 thd   kados: you would need to open each biblio to see the subjects
23:53 thd   kados: The textbox search returns a list of biblios.
23:53 thd   kados: but you did not have a list of matching subjects and only matching subjects from the textbox
23:52 kados sure, that one works ... but it also works if you just type it in the text box
23:52 thd   kados: They can be fixed though
23:51 thd   kados: the JavaScript links on the right are not correct
23:51 thd   kados search forest and then choose the first authorised value Rain forest ecology -- Juvenile literature
23:49 kados I was picking 'select and close'
23:49 thd   for the authorities search
23:49 kados ?
23:49 thd   kados: you have to use the values on the left column
23:48 kados the problem is that the only thing the pop up dictionary search does is fill text values int he normal search box
23:47 thd   kados: it may be in part that the linking is not correct
23:47 kados not one result but three
23:47 kados pick 'rain forest ecology'
23:46 kados try it with the authorities values too
23:46 thd   kados: I see I have six instead of 4 although it works for the part labelled authorities or seems to well enough
23:44 kados but there aren't :-)
23:44 kados there should only be 4 reusults right?
23:43 kados and select 'forest animals'
23:43 kados search on 'forest'
23:43 thd   kados: the selection list has biblio counts but not biblios.
23:42 kados (also, bad example because there are only results with 1 record)
23:42 kados how are the results any different than just typing in the values?
23:41 thd   kados: initiate the search by clicking on '...' of course
23:41 thd   kados: then choose any single result you get that result only
23:40 thd   kados: search for United States as a subject
23:40 thd   kados: It is labelled authority search but it is not really since it works fine with no authorities built
23:39 kados can you show me an example?
23:39 thd   s/fro/for/
23:38 thd   kados: The link search works fine except for some template issue fro the right column JavaScript
23:37 thd   kados I will check the UNIMARC use of the leader there which is different
23:36 kados however, there are 8 possible types of headings
23:36 kados there are 7 possible leader values for position 9
23:34 kados which from what I can tell is different than the headings
23:33 kados have a one-to-one corolation to leader position 9
23:33 kados he seems to have intended that the authorities frameworks
23:32 kados looking at paul's current code
23:31 thd   in which case the template should be fixed
23:30 kados like i said ... if you can find an example ... I'd be very excited :-)
23:29 thd   kados: That is because you always choose the hot air option when you are done and not the hot air balloons option
23:28 kados but I've yet to see it working in Kokha
23:28 thd   kados: the search should be an exact field search except for problems with MARC in SQL.
23:28 kados in theory
23:27 thd   kados: do you see that distinction?
23:27 thd   s/baboons/balloons/
23:26 thd   kados: however, if you search for hot air as value restricted and choose hot air balloons it will not find merely hot air.
23:25 thd   kados: if you search for hot air as value restricted and choose hot air it is not designed well enough to give you only hot air and not hot air baboons.
23:24 kados from what I've seen all it does is a normal search
23:23 kados if you can find a search where it works let me know
23:23 thd   kados: only if you use the wrong query terms
23:23 kados but it certainly doesn't work that way
23:23 kados that may be the way it _should_ work
23:22 thd   kados :0
23:22 kados that's actually not true :-)
23:22 thd   kados: It searches only the value chosen in the result
23:22 kados it's just like doing a search before you do a search
23:22 kados heh ... as if that does anything :-)
23:22 thd   kados: value restricted is what the '...' search does in the OPAC now.
23:21 thd   kados: The same mechanism must be extendable to the authority frameworks, however, if a column is added to the bibliographic frameworks.
23:21 kados what is a 'value restriction search'?
23:19 thd   kados: just as the see also column extends the string search the link column extends the value restriction search.  however that is not the same as an authorities search.
23:18 kados when you go to do a search you have to select a type
23:18 kados also, that does not solve the problem that the search types are directly linked to the frameworks
23:17 thd   kados: I tried to ask paul what it did precisely and although he was unclear in his memory he seemed to agree that my suggested likely use was correct.
23:17 kados in fact I don't know what it does
23:17 kados I have yet to see that work
23:16 thd   kados: The link function in the biblio frameworks.
23:16 kados where?
23:16 kados ?
23:16 thd   kados: There is already code for changing the search.
23:15 kados that would be easier than changing the search I think
23:15 thd   kados: Grouping would be better but there is no code for that yet.
23:14 thd   kados: It is not an advantage it is the existing design.
23:14 kados instead of grouping the frameworks?
23:13 kados what is the advantage to having so many frameworks in Koha?
23:13 thd   kados: you can group the inde4xes together
23:12 thd   kados: you can build a search to search more than one.
23:11 thd   kados: I was referring to authority frameworks linked to a 1XX $a in an authority record.
23:11 kados which we don't want
23:11 kados if we have more than four authority frameworks in Koha there will be more than 4 search points
23:11 kados what did you mean?
23:10 thd   kados: that is different usage of type that what I meant
23:10 kados because they all use different tags
23:10 kados they will still retain their types
23:10 kados and those 7 can be grouped easily into 4
23:10 kados position 9 in 008 only has 7
23:10 thd   kados: More than 4
23:10 kados more than 7?
23:09 thd   kados: you can and should group them but there are more authority types in the standard
23:09 kados I've never seen an authorities search with all 7
23:09 kados do we want more than 4 search points?
23:08 thd   kados: why only 4 authority types?  You are missing some.
23:08 thd   kados: ok the information needed to make such a script work is partly in the method UNIMARC uses for building authorities using a standard set of codes for authority types.
23:05 thd   kados: The older MARC records from retrospective conversion of pre-MARC printed cards have issues like racist subject headings that keep them out of CDS distribution until the updating is complete.
23:01 thd   http://www.loc.gov/cds/mds.html#ba
23:01 thd   kados: look at the beginning dates for the retrospective files from CDS
22:59 thd   kados: there is a very large group of records that they still do not distribute through CDS even for money
22:52 thd   there is no "Search access to form, genre, and topical subject subdivisions"
22:51 thd   kados: yet it would still be incomplete because ...
22:50 thd   kados: apart from contract access to some of their content
22:49 thd   kados: The only way that could really work though is by IP address.
22:48 thd   kados: The answer I was given was that there was a limitation on the number of records in a given period
22:48 thd   kados: I had asked someone at CDS about doing that  sort of thing manually, knowing that I could script t
22:47 thd   kados: I actually have some python script that I had used
22:46 thd   kados: I have seen that some people have overcome that issue
22:45 thd   kados: LC is a little tricky because of session initialisation
22:45 thd   kados: I have done that but not for LC
22:45 thd   kados: you could use LWP to write a script
22:44 kados thd: no prob ... I've got about 400 IP addresses :-)
22:44 thd   kados: LC will log your IP address and block you :)
22:42 kados thd: I wonder if we can batch download them slowly over the course of many days to arrive a a complete set of authority records for a client :-)
22:42 kados LOC says you can download their MARC records for use in a library system
22:40 kados looks like lots of serials
22:40 kados ooh ... they're not bad
22:39 kados thd: have you looked at them yet?
22:39 kados I also have the PINES data to go with them -- all 5 million records :-)
22:38 kados I have those too
22:38 kados thd: back
22:15 thd   courtesy of pines
22:14 thd   kados: I have 17k authorities from LC
22:12 kados thd: i will
22:12 kados anyway ... I'll be back in a bit
22:12 thd   kados; and explain four search points instead of a few more
22:12 kados thd: (if you know of some we could use or want to download a bunch from LOC that might be helpful)
22:12 kados thd: (the problem is that we dont' have any good auth records)
22:12 kados thd: when I get back I'll start working on an import script
22:11 kados thd: I have to step out for a bit -- get some dinner
22:11 kados thd: because there should only be four search points
22:11 kados thd: i deleted the other auth types
22:07 thd   I think that requires searching the UNIMARC framework code to find where they are used
22:05 thd   maybe :)
22:05 thd   kados: Those codes need to match the authority type.
22:04 thd   kados: These are in all capitals in French
22:04 thd   kados: the hash is storing codes to identify the authority types
22:03 thd   kados: I may see the problem for not finding the biblio records
22:01 thd   kados: what happened to the various authority types from last night?
22:00 kados dunno I haven't really looked at it
21:57 thd   ?
21:57 thd   kados : so what lines do the matching
21:56 kados :-)
21:55 kados results for search fixed
21:49 kados build_authorities.pl
21:49 thd   kados: where does the matching algorithm live?
21:49 kados well actually ... notice that they have subdivisions included
21:49 kados poor algorythm for matching
21:48 kados yep
21:48 thd   kados: There are multiple   	Frontier and pioneer life Fiction when searching frontier
21:48 thd   kados:	Frontier and pioneer life Fiction
21:47 kados which search does that happen on?
21:47 kados ahh ...
21:47 thd   No results found.
21:47 thd   kados we need to fix Results for Search: 1009 = 3509
21:47 kados anything to put off writing import scripts :-)
21:46 thd   yaay
21:43 kados in the display
21:42 thd   kados: we need to get build_authorities.pl working before we can marry the two.
21:42 thd   kados: I had a half reasonable understanding of how bulkmarcimport.pl worked a few months ago.
21:40 thd   kados: or at least Koha would have that system beat if real authority records were in Koha
21:37 thd   kados: Koha has that system beat already.
21:37 thd   kados: but it does not help the cataloguer search against 4XX 5XX when typing
21:35 thd   well actually it is more like autocomplete
21:35 thd   kados: LC uses a system that checks existing uses and provides a drop down list after the cataloguer has already typed everything
21:34 kados we can do better than that :-)
21:33 thd   kados: most systems simply verify cataloguing against the authorised form after the cataloguing data has been entered.
21:32 thd   kados: existing systems that use them well are rare to none
21:31 thd   kados: but that would help you only a little.  Authorities only do what they should when you import the NACO authorities.
21:30 thd   245 $c
21:28 thd   kados: although you could try to extract the form of author names used on the material itself from the statement of responsibility
21:28 thd   kados: You cannot fill 4XX, 5XX in the authority records by building from bibliographic records.
21:26 thd   in a biblio you get 150 in an authority record.
21:25 thd   kados: so starting from 650 ..
21:25 thd   kados: the 1XX is in the authority record
21:25 kados even if the record has values in 6XX and 7XX?
21:24 thd   kados: you can only construct 1XX in the authority records which is why that is the poor person's system
21:23 kados I mean, how do we construct the auth record values from the bib recor dvalues?
21:23 kados thats' not what I meant
21:23 thd   ?
21:23 thd   kados: However, you knew that so what had you meant by your question
21:22 thd   kados: bib records are mapped to auth records with $9 in each of the controlled fields
21:21 kados how do we map from a record to an auth record?
21:21 kados the question is
21:21 kados I suspect we will need to rewrite it
21:20 thd   kados: yes, I am merely tossing out a guess without real inspection of the code or asking paul or hdl
21:20 kados hmmm ... I still don't fully understand what paul's hash is used for
21:19 thd   kados: my suggestion was to use only 'a' as the key
21:19 kados but I'm happy we're getting there :-)
21:19 kados there is much to do in building a given record yet
21:18 thd   kados: we have to overcome the problem for building records whee it did not find the records
21:18 kados how do we tell what type of heading it is most efficiently?
21:15 thd   kados: that is beautiful
21:15 thd   kados: much better
21:15 kados how's that?
21:13 thd   certainly patrons do not care what the record number is
21:13 thd   MARC for Twain, Mark, 1835-1910 or something better after more thought and example examination from other systems
21:11 kados like what?
21:11 thd   The OPAC should still have nicer text instead of Authorized Heading(#4074)
21:10 kados personal name, corporate name, etc.
21:10 thd   beautiful
21:10 kados yea i intend to put the type in there
21:09 thd   kados but  you left the column in heading row
21:08 kados I'll need to get rid of that :-)
21:08 thd   delete should not be in the OPAC :)
21:08 kados heh ... aactually it might actually delete :-)
21:07 thd   kados: and I hope that delete does nothing in the OPAC :)
21:06 thd   kados: MARC for Twain, Mark, 1835-1910 but I am sure the description could improve with some consideration and examination of other systems.
21:05 kados give me an example
21:04 thd   kados: Authorized Heading(#4074) could use better display text such as MARC for whatever is in the 1XX
21:04 kados i suspect that's because the bulk import didn't do everything
21:04 kados subject headings don't really work very well
21:04 kados ok ...
21:01 kados gotcha
21:00 thd   kados: in the OPAC at least the link to the MARC record for the authority should be a last column, not a first column
20:59 kados what should be on the right-hand column?
20:59 thd   kados: the patrons want to find the material catalogued not usually the MARC displays
20:58 thd   kados: and for the MARC in the OPAC that should be on a rightmost column
20:57 thd   wow no not in the usual displays that I have seen
20:57 kados thd: you sure the heading shouldn't take you to the MARC?
20:53 kados woot ... working
20:48 thd   kados: I know that everything throughout Koha mostly tries to use the anchor link content identical to the anchor display content.
20:46 kados I'll try
20:46 thd   kados: what about linking the heading instead of the hit count?
20:46 kados yep
20:45 thd   however once everything else is perfect that could be fiddled with
20:45 thd   kados: a dictionary list with the right CSS might look just slightly better typographically than break tags
20:44 kados so what's next? :-)
20:43 kados great
20:43 thd   I mean same fine :)
20:42 thd   the intranet is the same :)
20:42 thd   the OPAC is fine
20:41 kados check again
20:41 kados heh
20:40 thd   kados: i just checked the intranet and it is off just a little with spacing :)
20:40 kados we may have achieved perfection :-)
20:40 kados thd: check the opac for 'Twain' now
20:31 thd   kados: it does not seem to be on the web yet although some inadequate early draft is there from before politics and time wore down the draft author.
20:29 thd   Price: EUR 34 (IFLA Members EUR 26,80)
20:29 thd   (IFLA Series on Bibliographic Control; vol. 27).
20:29 thd   ISBN 3-598-24276-X
20:29 thd   M?nchen: Saur, 2005, 61 p.
20:29 thd   Final Report May 2005
20:29 thd   IFLA Guidelines for Online Public Access Catalogue (OPAC) Displays.
20:20 thd   kados: which intranet subdomain is this?
20:20 thd   kados: really, I have no 500 error
20:18 kados hehe ... 500 error :-)
20:17 kados adding it now
20:16 thd   kados: we know that we can create Twain
20:15 thd   kados: ok
20:15 kados lets test the seealso case first
20:15 kados hehe ... trickier than it seems :-)
20:15 thd   kados: looks good, now move the hyperlink from the number of bib records to the heading
20:14 kados we still need to test cases where there are 'see also' entries
20:13 thd   kados: the IFLA standards for OPAC displays have been published for a few months but I have not checked to see if it has hit the web yet
20:13 kados thd: look now
20:13 kados thd: bingo
20:12 thd   kados: This indentation I just posted seems more appropriate.
20:11 thd   kados: I think if you outdent the 4XX then that is for browsing a large alphabetical list
20:10 thd         see: Lewis, C. S. (Clive Staples), 1898-1963.
20:10 thd      Hamilton, Clive,
20:10 thd         see: Lewis, C. S. (Clive Staples), 1898-1963.
20:10 thd      Lewis, Jack,1898-1963
20:10 thd   Lewis, C. S.(Clive Staples), 1898-1963.
20:09 thd   kados: exactly
20:09 kados but there is no 'see' entry for it
20:09 kados right
20:08 kados it's indented
20:08 thd   kados: yet the 400 is still indented underneath th heading
20:07 kados thd: but that's not on LibLime's opac is it?
20:07 thd   kados: the Twain example has both 500 and 400
20:07 thd   kados: no they have both
20:06 kados we need an example with multiple authorized headings to test my code
20:06 kados yep
20:06 thd   kados: so that is the difference or the degree of indentation?
20:06 kados but authorized headings never reference unauthorized headings
20:05 kados authorized headings reference other authorized headings
20:05 kados unauthorized headings reference authorized headings
20:04 kados thd: (on liblime's opac)
20:04 kados thd: only unauthorized ones
20:04 kados thd: there are no alternative authorized headings
20:04 kados thd: in the Lewis example
20:03 thd   kados: I have never actually read the Understanding MARC Authority Records.  It is not as old as Understanding MARC Bibliographic which first helped me to understand MARC well.
19:59 thd   kados; well they are both obviously for computer displays but the second one looks more like a sequential browse in a large alphabetic list
19:56 thd   kados: I do not know what context is different except that I suspect the earlier example was for a computer display
19:55 kados I'm changing it ... just a sec
19:55 kados right, I see that now
19:55 thd   kados: I had modelled your first Twain example from earlier
19:54 thd   kados: we were referencing different pages just now
19:53 thd   in lines 2 and 3
19:52 thd   kados: I do not understand why they have the see from listing in their example but they do
19:52 kados there shouldn't be 'see' options under the main heading
19:51 thd   kados: also they have lines 2 and 3
19:51 thd   kados: now that it is fixed focus on how everything is indented relative to the heading
19:51 kados ok
19:50 thd         see: Lewis, C. S. (Clive Staples), 1898-1963.
19:50 thd      Hamilton, Clive,
19:50 thd         see: Lewis, C. S. (Clive Staples), 1898-1963.
19:50 thd      Lewis, Jack,1898-1963
19:50 thd          see: Hamilton, Clive,
19:50 thd          see: Lewis, Jack,1898-1963
19:50 thd   Lewis, C. S.(Clive Staples), 1898-1963.
19:50 thd   kados: just look at the relative indentation
19:49 thd   assume I had posted that bit correctly
19:49 thd   kados: I just had not corrected that when I posted that again
19:49 thd   that was my mistake
19:49 kados so you can't ignore that because I think it should affect the display
19:48 kados see means it's not
19:48 kados see also means it's authoritative
19:48 thd   kados can't what?
19:48 kados we must be looking at different pages
19:48 kados but actually you can't
19:48 thd   kados: look at the indentation
19:48 kados ok
19:47 thd   kados: i have confused see and see also so ignore that
19:47 thd         see also: Lewis, C. S. (Clive Staples), 1898-1963.
19:47 thd      Hamilton, Clive,
19:47 thd         see also: Lewis, C. S. (Clive Staples), 1898-1963.
19:47 thd      Lewis, Jack,1898-1963
19:47 thd          see: Hamilton, Clive,
19:47 thd          see: Lewis, Jack,1898-1963
19:47 thd   Lewis, C. S.(Clive Staples), 1898-1963.
19:47 thd   compare ...
19:46 kados See Woolf, Virginia, 1882-1941
19:46 kados Woolf, Virginia Stephen, 1882-1941
19:46 kados See Woolf, Virginia, 1882-1941
19:46 kados Stephen, Virginia, 1882-1941
19:46 kados Woolf, Virginia, 1882-1941
19:46 kados what is the difference?:
19:46 kados    see: Lewis, C. S. 1898-1963 (Clive Staples),
19:46 kados Hamilton, Clive,
19:46 kados    see: Lewis, C. S. 1898-1963 (Clive Staples),
19:46 kados Lewis, Jack, 1898-1963
19:46 kados Lewis, C. S. 1898-1963 (Clive Staples),
19:45 thd   kados: and if you look closely everything after the heading is indented relative to the heading
19:45 thd   kados: you have the last 4 lines but you dropped the 2nd and 3rd line
19:45 kados boldness for the first heading
19:44 kados  so do they :-)
19:44 thd   sorry you have boldness, and partial indentation
19:43 kados http://www.loc.gov/marc/uma/pt12.html
19:43 kados thd: it matches this perfectly I think:
19:43 thd   kados: but what you have is not confusing and looks beautiful
19:42 thd   kados: I mean indentation boldness and the two see from lines just under the heading.
19:41 kados thd: only because the data is incorrect :-)
19:41 thd   kados: I can fix it though
19:41 thd   kados: that works although it does not match the LC example exactly yet.
19:39 kados                 }
19:39 kados                         $summary.= "&nbsp;&nbsp;&nbsp;<i>see:</i> ".$heading."<br>";
19:39 thd   kados: That is why you need to pass a couple of variables to generalise it
19:39 kados                         $summary.= $field->as_string()."<br>";
19:39 kados                 foreach my $field ($record->field('4..')) {
19:39 kados                 my $summary.="<b>".$heading."</b><br>";
19:39 kados                 }
19:39 kados                         $heading.= $field->as_string();
19:39 kados foreach my $field ($record->field('1..')) {
19:39 kados IMO this is a better approach:
19:38 kados but if I recall there is much cardcoded in it
19:38 kados I'll have to reread that code
19:38 kados so in my mind it's never going to work properly
19:38 thd   kados: using code like what is in getMARCsubjects ?
19:38 kados it can't represent a hierarchy
19:38 kados the current ISBD system must die
19:37 thd   kados: However, you can easily fix that within the broken ISBD system
19:37 kados thd: I rewrote the way that $summary is populated
19:37 kados thd: I'm not
19:37 thd   kados: if you are using the existing Koha ISBD backwards system then you have forced it to be incorrect even if the record were correct
19:36 kados thd: how does the Lewis entry look to you?
19:36 kados thd: I would be happy currently to just get it working with correct data
19:36 kados thd: that is a version 4 goal :-)
19:36 kados (unless it's caused by improper MARc edit tools :-))
19:35 thd   kados: you can force it to appear more correctly
19:35 kados thd: of course, it's not the programmers reponsibility to fix improper cataloging
19:35 kados thd: it should work properly if the data is correct
19:34 kados thd: see if it's what you want
19:34 kados thd: check the Lewis entry now
19:26 thd   Where the '--' does not apply to name fields but only to topic fields.
19:24 thd   kados: It needs to be generalised with a variable for what type of field it needs to return so it knows how to apply spaces and/or '---' between subfields.
19:22 thd   kados: It is really very simple after staring at it for long enough :)
19:20 thd   kados: I understand that code well and can adapt it for any field
19:20 thd   kados: paul had created getMARCsubjects in SearchMarc.pm for this very problem.
19:16 thd   s/was/way/
19:15 thd   kados: the one you looked at last night
19:15 thd   kados: The correct was is the routine from SearchMarc.pm
19:14 thd   when I substituted your example XML
19:14 thd   kados: I supplied you with ISBD code that forces things to the order that is usually correct
19:13 kados there is no way we can represent things in the right order using the current code
19:04 thd   kados:  <dd> will give you a drop indent
19:02 thd   kados <dl>
19:01 thd   kados: dictionary usually render hierarchically but that can be enforced in CSS
19:01 kados I have no idea what you mean by that
19:01 thd   kados the user display can use indentation with an HTML dictionary list
19:00 kados thd: yes from the user display
19:00 kados it seems from the spec like it's just meant to be pre-defined
18:59 thd   kados: what lack of acknowledgement are you referencing.  Do you mean the user display?
18:59 kados i don't think ISBD is meant to be user configuratble
18:58 thd   multiple spaces are reduced to one by browser rendering so that would be no problem
18:57 thd   { 100a }
18:56 kados curly braces?
18:56 thd   kados: spaces work inside curly braces for the ISBD preference
18:55 kados with subfields being 'inside' of tags
18:55 kados is that there is no acknoledgement that this is a hierarchy
18:54 kados the major problem here
18:54 kados spaces don't do anything that I can tell
18:45 thd   kados: spaces need to be inside the brackets to function
18:44 thd   kados: although spaces at that point make no difference
18:43 thd       <see_also>[ 500a ][ 500b ][ 500c ][ 500q ][ 500d ][ 500e ]</see_also>
18:43 thd       <see>[ 400a ][ 400b ][ 400c ][ 400q ][ 400d ][ 400e ]</see>
18:43 thd       <auth_heading><b>[ 100a ][ 100b ][ 100c ][ 100q ][ 100d ][ 100e ]</b></auth_heading>
18:42 thd   kados in my example remove the spaces between ] and [ to get ..
18:39 thd   kados: If you can do the problematic ones then you can do any ones
18:39 thd   kados: Getting it correct requires looking hard for the most difficult records.
18:38 thd   kados: yet he seemed to have even been using examples from libraries that were not following the UNIMARC standard correctly already.
18:37 thd   kados: Which is what paul had presumed from the data he had seen
18:36 thd   kados: It is a simple way if all the records that you looked at led you to believe that orderliness matched alphabetic order
18:35 thd   kados: yes repeated fields work improperly unless they happen to be repeated just next to one another in the original record
18:35 kados that's an insane way to deal with MARc data
18:34 kados wtf
18:34 kados my @fields = $record->fields();
18:34 kados aak!
18:34 thd   kados: I have used the CGI module for the same purpose in the past
18:33 kados I'm going back a level to look at how the fields are coming out from the db
18:33 kados ahh
18:33 thd   kados: I mean that I have not learnt the usage for the module yet
18:32 kados thd: HTML::Template
18:32 kados [ 100a ] [ 100b ] [ 100c ] [ 100a ] [ 100b ] [ 100c ] [ 100a ] [ 100b ] [ 100c ]
18:32 kados instead of
18:32 thd   kados: but I do not know the template module that Koha uses yet
18:32 kados [ 100a ] [ 100a ] [ 100a ] [ 100b ] [ 100b ] [ 100b ] [ 100c ] [ 100c ] [ 100c ]
18:31 kados they will come out like this :
18:31 kados and in your data you have two of each of those (repeatable)
18:31 kados if you put [ 100a ] [ 100b ] [ 100c ]
18:31 thd   kados: I have a simpler solution
18:31 kados thd: here's the problem with isbd
18:31 thd   kados: the <b> belongs in the template really
18:30 kados thd: because what i had was too convoluted
18:30 kados thd: I had to revert back to cvs code
18:30 thd   </heading>
18:30 thd       <see_also>[ 500a ] [ 500b ] [ 500c ] [ 500q ] [ 500d ] [ 500e ]</see_also>
18:30 thd       <see>[ 400a ] [ 400b ] [ 400c ] [ 400q ] [ 400d ] [ 400e ]</see>
18:30 thd       <auth_heading><b>[ 100a ] [ 100b ] [ 100c ] [ 100q ] [ 100d ] [ 100e ]</b></auth_heading>
18:30 thd   <heading>
18:30 kados thd: where?
18:30 kados thd: er?
18:29 thd   kados: I had fixed what you had originally
18:29 kados thd: i can't even begin to figure out how to fix it
18:29 kados thd: man, you're not kidding isbd was done backwards!
17:57 kados in a loop
17:57 kados I'll just hand the different types to the template
17:57 kados I know how to do it
17:55 kados I may need to go back a level and take a look at how this object is created
17:53 kados is for a given tag
17:53 kados because as the object comes out there is know way to know what the last subfield iw
17:52 kados it's quite hard in fact
17:48 thd   kados: unfortunately they take up too much space for me to keep them at hand :)
17:47 thd   kados: I have 2 copies of those massive volumes
17:47 thd   kados: Card catalogues are completely gone but you can still see this in the massive printed volumes of LCSH
17:46 thd   kados: the main card would not have had the see from as I recall
17:45 thd   kados: there would have been other cards matching the additional lines
17:45 kados I'll see what I can do
17:45 kados I think I understand
17:44 thd   kados: So as this was derived from a card catalogue
17:44 thd   kados the see in the authority is supposed to be understood as a see from in the authorised authority
17:43 kados that links to the main authorized heading
17:42 thd   kados: the see is actually a see from
17:42 kados what you want is for a separate entry for all of the headings
17:42 thd   kados: right underneath there is the qualification that searching otherwise will find where you are already
17:41 kados s/not/got/
17:41 kados then you've not unauthorized headings in 5XX
17:41 kados then you've got alternative authorized headings in the 4XX
17:41 kados you've got one main authorized heading in the 1XX
17:41 kados so in marc authorities
17:40 thd   kados: or less informative as I had wrongly suggested originally
17:40 thd   kados: which is why user displays have to be more informative
17:40 kados thd: it's not my fault they use 'see' and 'see also'
17:39 thd   signifying go and search for Lewis Jack to find something
17:39 kados thd: but that's just the stupidity of MARC
17:39 kados you want those 'see' entries listed separately _again_?
17:39 thd   kados: that looks like an instruction to the user to me
17:38 thd   yes
17:38 kados that's what I have now
17:38 kados    see: Hamilton, Clive,
17:38 thd   :0
17:38 kados    see: Lewis, Jack,1898-1963
17:38 kados Lewis, C. S.1898-1963 (Clive Staples),
17:38 kados wow ... I really don't understand
17:38 thd   the extra lines do that
17:38 thd   to the user
17:38 thd   kados: of course so make that explicit
17:38 kados in fact, they are all part of the same authority record
17:38 thd   kados: the extra lines qualify that
17:37 kados but you wont!
17:37 thd   kados: that much conveys to the user that if you search for Lewis, Jack you will find something different
17:37 kados especially now that they are highlighted in red if you searched for them
17:37 kados why would you want Lewis Jack and Hamilton Clive listed separately from the main authority?
17:36 kados    see: Hamilton, Clive,
17:36 kados    see: Lewis, Jack,1898-1963
17:36 kados Lewis, C. S.1898-1963 (Clive Staples),
17:36 kados a search for Lewis gives me:
17:36 kados I don't understand
17:36 thd   kados: maybe they should be see not see also
17:35 thd         see also: Lewis, C. S. (Clive Staples), 1898-1963.
17:35 thd      Hamilton, Clive,
17:35 thd         see also: Lewis, C. S. (Clive Staples), 1898-1963.
17:35 thd      Lewis, Jack,1898-1963
17:35 kados which lines?
17:35 kados four more lines?
17:35 thd   kados: do you not see the added value of 4 more lines?
17:35 kados it does
17:34 thd   kados: I understood that searching on a 4XX, 5XX, etc would let me find the authority for 1XX
17:33 thd   kados: oh yes you have not fixed the authority record editor yet
17:33 kados thd: if a correct record were imported it would display correctly
17:32 kados thd: that's a record editor problem
17:32 kados thd: ok :-)
17:32 thd   kados: the record is wrong :)
17:32 kados thd: (in my modified display that is)
17:32 kados thd: currently, the display is ordered in the same way as the record
17:31 thd   i.e. the correct relative place for $q
17:31 thd   kados: I pasted just now the correct place for X00q and also spacing separating the subfields
17:29 kados thd: what did you post?
17:29 kados thd: tell me what you think of my change
17:28 thd   kados: #100||{ 100a }{ 100b }{ 100c }{ 100q }{ 100d }{ 100e}|
17:28 kados thd: it will now style the terms you used in the results
17:27 kados thd: or Lewis, Jack
17:27 kados thd: try searching now for Hamilton, Clark
17:21 thd   kados: note the change in date ordering
17:21 thd         see also: Lewis, C. S. (Clive Staples), 1898-1963.
17:21 thd      Hamilton, Clive,
17:21 thd         see also: Lewis, C. S. (Clive Staples), 1898-1963.
17:21 thd      Lewis, Jack,1898-1963
17:21 thd          see: Hamilton, Clive,
17:21 thd          see: Lewis, Jack,1898-1963
17:21 thd   Lewis, C. S.(Clive Staples), 1898-1963.
17:21 thd   kados starting again  ...
17:20 thd   oops
17:20 thd   see: Hamilton, Clive,
17:20 thd   see: Lewis, Jack,1898-1963
17:20 thd   Lewis, C. S.1898-1963 (Clive Staples),
17:20 thd   kados: it should be as follows
17:15 kados that's what I have already
17:15 thd   see: Hamilton, Clive,
17:15 thd   see: Lewis, Jack,1898-1963
17:15 thd   Lewis, C. S.1898-1963 (Clive Staples),
17:14 thd   kados: this much is fine for now although indentation and authorised term in bold would help
17:14 kados ok
17:13 thd   kados: I will do 2 lines at a time
17:13 thd   kados: I did not want you to wait while I typed them
17:12 thd   kados: I will change the LC example to match the extra lines needed for Lewis
17:12 thd   kados: I am doing a poor job of explaining this
17:12 kados thd: the user is always sent to the authority record
17:11 kados thd: we have no results for 'see' that I know of
17:11 thd   kados: look at the LC example for every see they also have the line showing that you get right back to the record you have already
17:10 kados what do you think?
17:10 kados so maybe we should have 'highlighting' so they can see where it matches
17:10 thd   kados: exactly but you have not made that clear to the user as in the LC example
17:10 kados with the current scheme
17:10 kados thd: the user will never see Lewis, jack as a main heading result
17:09 thd   the user may expect that searching on Lewis Jack you would get different bib hits
17:09 kados thd: it will still return the correct authorized heading
17:09 kados thd: if you search 'anywhere' for Lewis, Jack
17:08 thd   kados: if all the user sees is see Lewis, Jack 1898-1963 then
17:08 kados is that what you mean?
17:08 kados ahh ... so both the authorized and unauthorized should show up ...
17:07 thd   for the LC example.
17:07 thd   kados what I last posted comes before what I had first posted
17:06 thd         see also: Clements, Samuel Langhorne, 1835-1910
17:06 thd   Twain, Mark, 1835-1910
17:06 thd   you have only the equivalent of .
17:06 kados see: Hamilton, Clive,
17:06 kados see: Lewis, Jack,1898-1963
17:06 kados Lewis, C. S.1898-1963 (Clive Staples),
17:06 kados how is what you posted above different from:
17:05 thd   kados: let me explain the difference
17:05 thd   kados: otherwise the user thinks that searching under a different 4XX term is going to find different set of bib hits
17:04 kados I did
17:02 thd   kados: underneath what you have already
17:02 thd         see: Twain, Mark, 1835-1910
17:02 thd      Conte, Louis de, 1835-1910
17:02 thd         see also: Twain, Mark, 1835-1910
17:02 thd      Clemens, Samuel Langhorne, 1835-1910
17:02 thd   the equivalent of ...
16:59 thd   kados: you need to add
16:59 thd   See Hamilton, Clive,
16:59 thd   See Lewis, Jack,1898-1963
16:59 thd   Lewis, C. S.1898-1963 (Clive Staples),
16:58 thd   kados: you now have ...
16:58 thd   kados: I had it right originally you need extra lines
16:57 thd   kados: no they are the same person are the not?
16:56 thd   kados: those are different people
16:55 thd   kados: nevemind
16:55 kados thd: you sure?
16:54 thd   actually the see is in the wrong place
16:54 thd   kados it is missing some lines
16:54 thd   kados: I have seen Lewis now but it does not match the LC model
16:52 thd   s/connection/connection explicit/
16:52 thd   kados: making the connection to the search term used by the user to arrive at the result is useful
16:51 thd   kados: I take back what I said about the printed card age and crowded displays
16:51 thd   kados: although that would make it explicit to the user why searching for Samuel Clements found Mark Twain
16:50 kados thd: look at the name auth record for Lewis now
16:49 thd   kados: that display is stuck in the printed card age
16:48 thd   kados: so is Clements, Samuel Langhorne, 1835-1910 a different authority record from Twain, Mark ?
16:46 kados they describe display of See and See also entries for opac interfaces
16:45 thd   kados: see also is 5XX I think
16:45 kados in that document (maybe the next page)
16:45 kados http://www.loc.gov/marc/uma/pt1-7.html#pt4
16:45 thd   kados: see also would be useful if it led to a different authority
16:44 kados thd: though I agree it could be better
16:44 kados thd: if we could reproduce the functionanlity there I would be happy as a clam :-)
16:44 thd   kados: LC is using left anchored searches only eeeewwww :0
16:44 kados no See or See also entries?
16:44 kados so the heading should display 1XX entries ... or else 7XX entries ... right?
16:43 kados k ... that's easy enough to change
16:43 thd   kados: Existing systems link the authorised heading not the biblio count to the biblios.  The authorities.loc.gov representation is unusual, not extensively developed, and fortunately not widely used.
16:42 kados thd: I was using loc as a model
16:40 thd   kados: The additional link with the authority record number or set of record numbers would be another link to the MARC record for the authority or even an authority detail display.
16:39 thd   kados: The biblio count should just be a count with no link embedded.
16:38 thd   kados: the authorised form that appears in the matching bibliographic record is what should be a hyperlink.
16:36 thd   kados: also I have been up earlier than I should have looking at the current display
16:35 thd   kados: why would you not display only the 1XX or 7XX (where displaying 7XX is dependent upon the context being past $a)
16:34 thd   kados: If you had real authorities would that not make a crowded display
16:33 kados yep
16:33 thd   kados: are you intending to display the 4XX and 5XX returned from the authority?
16:32 kados give me 5 minutes and I'll have something impressive :-)
16:32 kados and repeatability
16:32 thd   kados: maybe it is too much code to change for the moment but identifying the framework type if searching for more than one framework type would be helpful
16:32 kados it can't deal with ordering
16:32 kados but that has problems
16:32 kados yep it was
16:31 kados headings are always of the form 1XX
16:31 thd   kados: I think that variable was meant to hold the authority framework type summary
16:30 kados since the 'See' is always of form 4XX and 'See also' is always of form '5XX'
16:30 kados anyway, I think I have an idea for how to do it
16:30 kados but the variable is still called $summary and summary
16:29 kados yep
16:29 thd   kados: remember you changed the column name from summary in at least one place
16:28 thd   by summary do you mean authorised heading?
16:27 kados that's what you wanted I think
16:27 kados another alternative is to just have the system be smart enough to generate the summary from the data
16:27 thd   kados: what is there currently that serves that function?
16:26 kados wait ... no ... the xml you see above would go in the 'summary'
16:26 kados AuthoritiesMarc.pm even
16:26 kados uthoritiesMarc.pm
16:26 thd   kados: where is the place where it goes?
16:26 kados I spent a frustrating morning trying to figure out how the headings _should_ display
16:26 thd   :)
16:26 kados it doesn't exist yet
16:25 thd   kados: where is that code?
16:24 kados each <see> and <see_also> tag is repeatable
16:24 kados (good morning :-))
16:24 kados (for the markup)
16:24 kados </heading>
16:24 kados <see_also>[500a] [500d]</see_also>
16:24 kados <see>[400a] [400d]</see>
16:24 kados <auth_heading>[100a] [100d]</auth_heading>
16:24 kados <heading>
16:24 kados I think what we want to be able to do is something like this:
16:24 thd   kados: good morning :)
16:23 kados thd: I'm looking at the ISBD display for authorities currently
16:23 kados thd: you there?
15:40 kados paul_away: you don't happen to be present do you?