« April 2006 | Main | June 2006 »

May 31, 2006

Talis Source subscription period commences tomorrow

Libraries have been using Talis Source in anger for the last two weeks, but tomorrow those libraries who are subscribing to full ILL functionality or indeed free discovery will see the commencement of the subscription period proper.

I'm glad to say we have no problems to report, just lots of libraries getting on with things as normal. We have also been immensely pleased by the number of libraries who have asked to maintain their access to the full ILL functionality in Source. I hope to have some figures to share very shortly, when we have completed our phoning around exercise.

We are currently going through the process of contacting all libraries that we haven't heard from directly to ascertain their preferences. Unsurprisingly, most with very few exceptions, can see the value of maintaining access to free discovery with a commitment to contribute at least once during the course of the year if it is feasible. Any library that is concerned about the feasibility of contributing should talk to our Live Services Team who can assist in a number of ways.

May 30, 2006

Fascinating Facts......(2)

We're going up, up and away with contributions to the Platform. In case there is any perception that we're not accelerating our efforts....here's a few facts.

From January 2004 to January 2006, we processed 83,057,021 records. Since 1st January 2006, we have processed 35, 353,986 records. This means that we have processed approximately 47% of the sum total of records processed in 2 years, in a period of 5 months.

In ONE MONTH ALONE, (May 2006), we have processed 17,888,043 records compared with 19,579, 894 in the whole of 2004 and 28,123,141 records processed in the whole of 2005.

Since the beginning of 2006, 117 individual institutions have contributed their holdings to the Platform, compared to 138 institutions in the whole of 2005.

Our holdings this year have increased by 3 million records and counting....latest count, 45.3 million holdings.

Our bibliographic records have increased by 1.5 million records and counting.....latest count, 20.7 million records.

A massive testament to libraries who support the premise that a commitment to contribute holdings brings access to a hugely valuable FREE resource. A real architecture of participation.

May 26, 2006

Pass it on

I know that there has been a lot of discussion already around the Karen Calhoun paper The Changing Nature of the Catalog and its Integration with Other Discovery Tools. I have just been re-reading the paper and in particular Appendix C which provides excellent insight. Two quotes in particular stuck out for me, under the section entitled Cataloguing Tradition and Catalog Data.

Many recognize that the MARC communications format created much that was unique but is now out of date, and that the future lies in the convergence of MARC data within the global information network.
...one interviewee argued that "libraries should be using their cataloging data more aggressively than in the past, processing it more, passing it around more."

We've talked about this in the context of liberating your data and not "holding your data hostage" on a couple of occasions already. But, after my entry yesterday where we discussed the issue of "who owns the record?" And libraries questioning, "is it mine to give?" I think this issue is only going to get more attention in the future.

We have some experience of this in the context of Talis Base. Here we have a cooperative cataloguing service providing high-quality MARC records to participating libraries. And, many of those libraries participate in other initiatives like COPAC and SUNCAT too. Restricting the flow of those records that may have been derived in Talis Base ultimately restricts the opportunity that libraries have to pursue their own agendas, be they research, subject, regionally or nationally based. We woud prefer instead to have a common understanding with the domain that the flow of data is necessary if we are to deliver services that can take advantage of the next wave of technologies.

So, when does a catalogue record cease to be an item that can have ownership exerted over it, and start to become a collection of facts that can be re-purposed in multiple contexts?

Technorati Tags: , , , , ,

May 25, 2006

The "right" to contribute

An interesting point has been raised recently by a library, around their right to contribute data to the Platform. Their concern, as I understand it, was based on the premise that at the moment they derive many of their monograph MARC records from "alternative" sources, in addition to their own cataloguing effort. So do they therefore have the right to contribute those records to the Platform?

There are a number of considerations here, which I will try and address individually. It is understood that libraries will often derive records from other sources as well as creating original records. Those records may frequently be derived from commercial sources. In the case of these derived records, a library may well strip out fields that are not deemed of value to their own local catalogue, or indeed add fields that have been identified as being of value. So do those records lose their provenance during that process of local rationalisation? In the case of Talis Base - the service where we have the most familiarity with this issue - we always advocate that records that are downloaded from Talis Base into local catalogues by libraries always retain the indicator of provenance, no matter how much they may be altered for local purposes, before resubmission to the Talis Base union catalogue.

What does this mean therefore in the context of submission to the Talis Platform? Well, submission to the Platform means that the record is retained in its entirety including its provenance. And obviously if we, or others, wished to launch a MARC record download service from the Platform, we would ensure that the originating parties' rights over those records were observed.

For libraries that are involved in originating catalogue records on a non-commercial basis, there is a similar requirement to understand the circumstances in which these records could be re-used and re-purposed. We want re-use from the Platform to be understood and indeed advocated, and so to that end we have recently published a draft for a Community Licence on which, we would welcome comment.

In the context of Source, a full contribution of MARC records to the Platform from a library means that we will use the record as an incidence that the library holds the item and therefore attach a holding record to a previously existing and licensed bibliographic record. (We use the British Library as our core bibliographic dataset.) In this case, the holdings record is purely a statement of fact, that the library in question holds that item. And of course, a statement of fact is not a property issue. Just as a table of contents from a book cannot be copyrighted, because it simply states the order in which chapters appear.

As mentioned in a previous blog entry, we are increasingly loading bibliographic records for items from libraries, where no BL record exists. These records tend to be originated locally, because they are itemising local studies materials, which do not have ISBNs - and are therefore not catalogued within the BL programme or any commercial process. We can't underestimate however, how important these records are, constituting as they do the "long tail" of items that libraries are synonymous with holding.

In summary therefore, I would make three points:
1. The MARC records that are submitted to the Platform retain their provenance and their ownership will alway be respected.
2. In Source, the records are used simply to enable a match to be made and are not visible or downloadable.
3. A holdings record is a statement of fact and does not present any licensing or copyright issue.

This whole area is of course virgin territory, which means that we like others are finding our way. But the locking away of data in proprietary silos will not ultimately provide us with the solutions we need for building new applications, so let's ask the questions and hopefully there is a way forward through this morass of concerns.

Technorati Tags: , , , , ,

May 24, 2006

Fascinating Facts.....(1)

One of the huge benefits of having a national aggregated dataset of holdings is that you can start to derive some really interesting information about UK libraries. Many things could become possible if that dataset could be refreshed in real-time , for example we could map trends, like ILL transactions, purchasing patterns and borrower activity around particular titles or subject areas. But that's in the future....

Right now, we are harvesting records at a phenomenal rate. The structure of Source enables libraries to submit records as complete MARC records (UKMarc or Marc21). Source hangs the holdings record off the bibliographic record and we take British Library data as the core bibliographic dataset. However, over the last two months we have witnessed a huge increase in the number of new bibliographic records being created. These are records being submitted by libraries, where no bibliographic record previously existed. I'm guessing that if the BL doesn't have that record as part of its core data, then we are looking at some pretty obscure items. 800,000 new items to be precise, now discoverable for the first time that weren't there two months ago - as the graph below illustrates. And of course in the context of Source now available for interloan.

source_growth.jpg

May 22, 2006

Everything changes but you

Seldom have I felt so much satisfaction from hearing customers say "nothing has changed" after we released Talis Source to a number of sites, prior to the go live date on Friday 19th May.

This was the litmus test for the work we needed to do to transition UnityWeb to Talis Source. We knew that many customers were just not in a position to transition to an entirely new system, with an entirely new look and feel in such a short space of time. And nor were they all able to accommodate the necessary retraining costs, which in reality boiled down to staff time away from the desk handling requests.

So, we were pretty pleased when we started getting comments back like these from our early release sites:

"...its the same and that's wonderful. Basically, thank goodness that it's there....I can't see any significant change, which is ideal for my staff who just want to carry on tomorrow as they did yesterday. We'll be continuing to use it!"
Carol Marshall, Hampshire

"Well, it's exactly the same, much to my relief, which means that staff can pick it up straight away"
Sheila Houldin, Cheshire

Lots of libraries commented to me on how worried the staff "at the coalface" were feeling about this whole period of change. It's a reminder I guess to any of us involved in software development from a business or technical perspective, that the sometimes arbitrary decisions we take have serious impacts on users, sometimes foreseen, sometimes not.

This impact was fortunately entirely foreseen, hence our decision as long ago as June 2005 to announce that we would continue the existing service. A decision which many at the time saw as a rather hard-nosed commercial decision, but has in fact had really practical benefits for our users.

Another practical benefit emerging for users of Talis Source comes from the removal of restrictions on the numbers of users each institution can now give access to. We have just received a request for additional user licences from one library that wants to give every single branch access to at least search and view the bibliographic and holdings data in Source. Perhaps requests from branch will arrive at central ILL units with full bibliographic information AND a location to enable far quicker processing?

So, perhaps I shouldn't be suggesting that nothing has changed.


May 19, 2006

Source goes Live!

Well, its the first day of Talis Source! The changeover went well, and congratulations need to be extended to all of the Talis staff who worked throughout the night to ensure this happened. Over the next few weeks, we'll be contacting those institutions who haven't yet indicated their licence preference (one-off renewal of £500 for the Full service, or taking our FREE resource discovery option) and registering them for the new service. I would ask everyone to chase those relevant departments, as subscriptions have now expired and its imperitive we ensure you have the licence type that meets your needs so you can maintain your ILL service. Former usernames/passwords will be maintained to June 1st.

To login to the service, just select the "Click here to Login" option for the Source website - existing usernames and passwords have been carried forward.

Data contributions are coming in thick and fast (I'll leave that for a future post, but we're anticipating some exciting growth in the holdings coverage as we move forward). If you need to arrange a data contribution, can I suggest mailing holdings@talis.com for further information.

If you are having any problems, or have any queries, contact the Talis Support desk who will be happy to help!

May 17, 2006

Welsh Library Portal Project announced

We've spent a lot of time talking about the Talis Platform and the benefits it offers the library community in terms of the reuse and repurposing of data. But its always good to see concepts put into practice, and the announcement regarding the Welsh Portal Project demonstrates this.

There was no Welsh regional representation tasked with the maintenance of UnityWeb, a forerunner to Talis Source, when I product managed that service. As a consequence, there was no focal point in Wales tasked with updating and maintaining holdings in UnityWeb - unlike other regions - despite the fact that it represented the largest aggregation of library holdings in Wales at that time. To be fair, perhaps this was a reflection of the conflicting demands on the time and resources of many Welsh libraries, perhaps there needed to be more compelling reasons for participation?

Which is why this announcement is so important. Lets fast forward to today when contributions are to a Platform, and the Platform services not only Talis Source, a successor to UnityWeb, but other initiatives. Many libraries in Wales may not be in a position to contribute data purely for the purposes of interlending. But when there is an added incentive to contribution ie. participation in a Welsh portal project, as well as national interlending activity, the effort can be more easily countenanced.

So, I look forward to working with many more libraries in Wales in the future, in offering an opportunity to empower their data, not for singular, but multiple initiatives. And, given the many barriers that libraries face to liberating their data, this is a welcome prospect.

Technorati Tags: , , , ,


May 16, 2006

Talis Research Day Presentations are available

You can now view the presentations from the 5th Talis Research Day. The event Building Resource Discovery and Sharing Systems on the Talis Platform was held on 9th May.

May 15, 2006

7 things you need to know about Source...

1. Every UnityWeb subscriber will automatically be switched to Talis Source for free discovery from 19th May. What could be easier than using your existing username and password for what was a paid-for service, and using it as a free service?

2. Those libraries that choose the £500 Talis Source interlending package will get 2 weeks free access to the Service. The subscription officially starts on 1st June. So any concern that they are not going to find Talis Source offering exactly the same level of service as they enjoyed previously, should be allayed with this two week grace period.

3. The software remains the same as UnityWeb with only minor cosmetic changes to reflect the name change, which means that staff do not have to take time out to learn a completely new system.

4. With the commitment to make one catalogue contribution in the space of a year, comes free look-up of the bibliographic and holdings database of over 41 million holdings in the UK. And that number is growing all the time as the range of libraries wishing to participate diversifies.

5. By subscribing or contributing to Talis Source you are in no way restricted in your right to contribute data or subscribe to any other ILL service. As we have made clear, data that is contributed to the Platform, which Source is using, is similarly available for other software vendors to use in their own applications.

6. If you have chosen to subscribe to the OCLC Pica UnityUK service you are not obliged to cancel your Talis Source subscription or remove your contribution. Each individual library is free to make its own decisions and subscribe/contribute to both if they choose.

7. Talis Source has now been released to Hampshire, Portsmouth and Cheshire. They are sending requests via Source as we speak, and the site will become available for all to use on 19th May.

Technorati Tags: , , , ,

Data milestones

The Live Services Team inform me that if we add up the number of records we have processed since 2004, we have just passed the 70 million mark this week. We are currently processing at a rate of around 6 million records a week, which means that we should be celebrating our 100 millionth record in about 5 weeks time!

May 12, 2006

Talis Source goes into a Limited Release!

Some excellent news today - a Limited Release of Talis Source has been made available to several Institutions. A Limited Release is not limited in its functionality - its the full working system as will be made available later next week - it's just limited in the group of people having access to it. This is the final step in validating that the system has been successfully rolled-out and an opportunity to receive a final nod that everything is working as it should.

We have three institutions taking part - Portsmouth, Hants and Cheshire - so everyone should expect to receive some email requests from these sites, identical to UnityWeb requests apart from the Talis Source heading. These a real requests, and should be dealt with as normal.

One thing all of these sites asked me was "...but do we need training?". The answer is "No"! One of the things we validated through our roadshows was that it was essential we maintained the service "as is" to provide a seamless continuity. Apart from a name change and an updated colour scheme for the interface (which I must admit to rather liking!) to familiarise your staff and yourself with, there is nothing else you need to worry about. Hopefully, this will ensure a smooth transition for everyone.

If you have any queries, do not hesitate to contact Talis.

May 11, 2006

Holding data hostage

We held a Research Day a couple of days ago, which many of our fellow vendors in the domain - AdLib, DS Ltd, Ex Libris, Innovative Interfaces, IS Oxford and SirsiDynix - attended.

I'm very grateful that they took the time out of their busy schedules to be involved in what turned out to be a useful day. Certainly the feedback we've received thus far has been positive. Of course, we know that there's a fair amount of healthy cynicism that exists between vendors and rightly so. We reside in a very competitive market. So I appreciate that there were discussions that took place internally before invitations were accepted. Questions like "what's the point?" and "what will we learn?" are obviously asked. And of course, in a domain like ours where collaboration has not been a watchword, I can't criticise that judgement.

Was it a Talis soapbox session? I hope not. We have a particular view of the world, which is open to challenge. So we really did appreciate the opportunity to have these perceptions challenged by other stakeholders in the domain and of course they did.

I was involved in a couple of the presentations, one which was "Broadening Participation". This session was a development of the arguments published in the "Broadening Participation" paper.

I'd like to expand on some of the themes from the Paper in subsequent entries. But suffice to say that in it we consider what the barriers are to libraries' participating in resource discovery and sharing initiatives. And one of those barriers is technical complexity.

Technical complexity, or the individualised requirements that libraries have for data export, is a justification that some vendors use for charging libraries for the export scripts they need. I don't know the rights and wrongs of this. Perhaps there is an amount of bespoke work required by libraries to enable only sub-sections of their catalogue to be exported which, in turn, requires developement from the vendors concerned.

I would welcome some debate on this. In fact, I would ask the question of libraries - do you ask your vendor to do complete catalogue exports? Or, do you ask your vendor to restrict exports to specific subsets of your catalogue? Because there are certain collections that you do not want to be exposed for interloan purposes?

I guess if you are submitting a contribution to a union catalogue primarily used for ILL purposes, then you are going to try and restrict the catalogue to those items that are actually available for interloan. But what if there is another way around this? What if a complete catalogue contribution could be effected, free-of-charge? And if the complexity of what is available for interloan and what is not could be tackled elsewhere?

That's essentially what we propose as the solution in the Talis Platform. We have a Directory which is scalable for the purposes of allowing libraries to register their ILL policies. It could be used to validate which holdings are available for interloan from a library which are not. But more about that in the future.

We believe that libraries should be able to liberate their data free-of-charge for the purposes of participation in whichever initiatives they see as important. On that basis, we've published our own scripts for Talis libraries to export their data, both for Talis Source and for the UnityUK service here.

It was refreshing to hear from other vendors like Ex LIbris and AdLib that they do not charge for exports either and never have done. I hope that libraries will ask why if they are having to pay for exports of their data, as Bert Drenth from AdLib put it, their data is being held hostage?

Technorati Tags: , , , , , , , , , , , <, , , , a


May 05, 2006

Contributing your data - but at what cost?

Next week on 9th May, Talis is running its 5th Research Day event. It will be focussing on the building of applications for resource discovery and sharing. And happily I can say that there will be a sizeable representation from other LMS vendors who have been invited to participate.

Having spent some time recently with our Live Services Team hearing about the problems libraries are encountering in making data contributions to the Platform, I hope the theme of the day will be around collaboration. It has become pretty clear that there has to be a community effort in recognising that freeing a library's data to enable it to participate in innovation and raise library awareness is key.


The biggest barrier for many libraries in participating is the cost of doing a data export. We're pretty relaxed about the formats that we take contributions in because we're trying to remove barriers to contributing wherever we can. But we had to draw the line recently when asked if we could accept a contribution of ISBNs that were handwritten. The cost of paying vendors for export scripts is regularly cited as a reason for not participating, which means that libraries' data remains locked away.

I really hope that we can have a good discussion with the LMS vendors who are attending about this, and I also hope that we can agree to try and collaborate on some kind of agreement that tackles this issue, because if we can, we could move to a point very quickly where the cost to a library of contributing data is removed completely. Which is a far cry from the situation that some libraries find themselves in, where many of them are paying to make their data accessible up to three times over.

Firstly, by having to pay their LMS vendors for the appropriate export script to get their data out of the system (as already discussed).

Secondly, by having to pay to contribute their data to a catalogue. Others have commented on this issue recently here and here. So, I don't intend to say anymore than that, other than making a data contribution to the Platform remains a free activity, and we'll try and load pretty much any electronic format you can give us.

Thirdly by having to pay a subscription to look-up the data. As many of you know, we've made look-up of bibliographic and holdings data in the Platform a free activity, providing the library makes a commitment to contribute its holdings at least once during the course of a year.

So, if we can just get our heads together on a protocol for making data exports a charge-free activity, then cost can cease to be an issue for libraries wishing to make their data work for them. Let's hope I have some good news to report on this after next week's event.

Technorati Tags: , , , , , , ,