<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>North Carolina Digital Collections Collaboratory &#187; evaluation</title>
	<atom:link href="http://digital.lib.ecu.edu/collaboratory/index.php?feed=rss2&#038;cat=30" rel="self" type="application/rss+xml" />
	<link>http://digital.lib.ecu.edu/collaboratory</link>
	<description>Bringing North Carolina Digital Collections Together</description>
	<lastBuildDate>Wed, 26 Jan 2011 20:56:04 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.0.1</generator>
		<item>
		<title>An opportunity to SPAM YOUR FRIENDS!</title>
		<link>http://digital.lib.ecu.edu/collaboratory/?p=497</link>
		<comments>http://digital.lib.ecu.edu/collaboratory/?p=497#comments</comments>
		<pubDate>Mon, 11 Oct 2010 12:43:52 +0000</pubDate>
		<dc:creator>Amy</dc:creator>
				<category><![CDATA[State Library of North Carolina]]></category>
		<category><![CDATA[evaluation]]></category>
		<category><![CDATA[state government]]></category>
		<category><![CDATA[assessment]]></category>
		<category><![CDATA[measurement]]></category>
		<category><![CDATA[Web Development]]></category>

		<guid isPermaLink="false">http://digital.lib.ecu.edu/collaboratory/?p=497</guid>
		<description><![CDATA[The State of North Carolina is redesigning its main website (www.nc.gov) and is seeking public input.   We want to hear from a wide range of people about what they want and need from the new site.  The goal is to build a site that makes it easier for everyone to obtain information about and perform [...]]]></description>
			<content:encoded><![CDATA[<p>The State of North Carolina is redesigning its main website (<a title="http://www.nc.gov/" href="http://www.nc.gov/">www.nc.gov</a>) and is seeking public input.   We want to hear from a wide range of people about what they want and need from the new site.  The goal is to build a site that makes it easier for everyone to obtain information about and perform transactions with NC state government.</p>
<p>Please consider taking a few minutes to answer a 9-question survey.  Feel free to share this survey through your social networks.</p>
<p>The survey closes at 5pm on Friday, November 5.</p>
<p><a title="http://www.surveymonkey.com/s/ncgovwebdesign" href="http://www.surveymonkey.com/s/ncgovwebdesign">http://www.surveymonkey.com/s/ncgovwebdesign</a></p>
<p>Thank you for your time.</p>
]]></content:encoded>
			<wfw:commentRss>http://digital.lib.ecu.edu/collaboratory/?feed=rss2&amp;p=497</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Messy Innovation and Stable Dysfunctionality</title>
		<link>http://digital.lib.ecu.edu/collaboratory/?p=337</link>
		<comments>http://digital.lib.ecu.edu/collaboratory/?p=337#comments</comments>
		<pubDate>Tue, 10 Nov 2009 20:28:36 +0000</pubDate>
		<dc:creator>Gretchen</dc:creator>
				<category><![CDATA[ECU]]></category>
		<category><![CDATA[evaluation]]></category>
		<category><![CDATA[services]]></category>
		<category><![CDATA[the profession]]></category>

		<guid isPermaLink="false">http://digital.lib.ecu.edu/collaboratory/?p=337</guid>
		<description><![CDATA[This messy, difficult thing is called innovation, and while it can cause angst for those who prefer stable dysfunctionality, it does make the Library ecosystem a richer and more diverse place. – Mark Leggott, LoomWare Lately I&#8217;ve been feeling that work is especially messy and difficult, so I appreciated this quote from Mark Leggott (in [...]]]></description>
			<content:encoded><![CDATA[<blockquote><p>This messy, difficult thing is called innovation, and while it can cause angst for those who prefer stable dysfunctionality, it does make the Library ecosystem a richer and more diverse place. – <a href="http://loomware.typepad.com/loomware/2009/11/a-response-to-stephen-abram-and-sirsidynix.html">Mark Leggott, <em>LoomWare</em></a></p></blockquote>
<p>Lately I&#8217;ve been feeling that work is especially messy and difficult, so I appreciated this quote from Mark Leggott (in response to the <a href="http://wikileaks.org/leak/sirsidynix-on-open-source.pdf">Stephen Abrams/SirsiDynix dust-up</a>) that characterized such work as &#8220;innovation&#8221; and a breath of fresh air compared to &#8220;stable dysfunctionality.&#8221;</p>
<p>If I begin to think of innovation as something that is by its very nature messy and difficult I gain a new perspective on the work that is being carried out by myself and my colleagues. While it&#8217;s great when you can find solutions to real world problems and can experiment with and learn from multiple solutions, there is also the very real issue of each new project&#8217;s cascading effect on other services. I feel like as soon as we implement something, even if it&#8217;s the most elegant thing we ever saw, we launch a second phase of cleaning up everything else to work with the new paradigm. Is this a failing on my part in leadership, or a necessary evil of innovation?<span id="more-337"></span></p>
<p>The typical paradigm of the workplace would lead me to believe that the messiness and difficulty of innovation is something I should at least mitigate if not outright squelch. But what would an innovative culture, that encouraged and fostered innovation actually look like?</p>
<p>In imagining such a workplace I am aided by the recent work of Krisellen Maloney, Kristin Antelman, Kenning Arlitsch and John Butler, who undertook a large-scale investigation of Future Leaders&#8217; Views on Organizational Culture. In both their <a href="http://prezi.com/0_vqnrzcthw0/">LITA Forum session</a> on the topic and their <a href="http://www.lita.org/ala/mgrps/divs/acrl/publications/crljournal/preprints/Maloney-Antelman-Arl.pdf">forthcoming article in College and Research Libraries</a>, the authors examine the desired vs. perceived actual organizational cultures at the workplaces of a large number of &#8220;future library leaders.&#8221;</p>
<p>Unsurprisingly, they found that many future leaders are unhappy with the current culture and desire one with more emphasis on innovation with high flexibility and an external focus. (In particular they used the <a href="http://www.jstor.org/stable/2631061?cookieSet=1">Competing Values Framework</a> (CVF), which stipulates <a href="http://www.bibliomining.com/nicholson/images/ltrendka_img_0.jpg">four models of organizations</a>: Clan, Adhocracy, Hierarchy, and Market. The authors found that the Hierarchical model was the most prevalent while the Adhocracy was the most desired.) </p>
<p>The &#8220;Discussion&#8221; section of the article briefly addresses what kinds of real organizational culture changes are desired and at least one path for organizations to identify and implement changes (doing a CVF analysis of their one institution). Some of the interviewees suggested changes that would value innovation from the top, move away from consensus-based decision-making when it was unwieldy, openness to staff suggestions, and thoughtful risk-taking. Such changes do not require however that organizations become chaotic or followers of fads. At the same time, interviewees did not want to completely throw out the collaborative, clan-like structure of libraries. Finding a balance between these seems to me to strike the middle ground between messy, de-stabilizing innovation and stagnant dysfunction. Stable enough, yet innovative perhaps?</p>
<p>I&#8217;d have to say that by these rubrics especially, I work in a library that is pretty open to innovation. Maybe that&#8217;s the reason Digital Collections is allowed to kind of make an innovative &#8220;mess&#8221; sometimes. This post has been kind of rambling, but I think I&#8217;m going to be pondering the tension between messy innovation and stable dysfunctionality for quite a while…</p>
]]></content:encoded>
			<wfw:commentRss>http://digital.lib.ecu.edu/collaboratory/?feed=rss2&amp;p=337</wfw:commentRss>
		<slash:comments>7</slash:comments>
		</item>
		<item>
		<title>Migration/Revitalization Survey &#8211; Your Input Needed!</title>
		<link>http://digital.lib.ecu.edu/collaboratory/?p=200</link>
		<comments>http://digital.lib.ecu.edu/collaboratory/?p=200#comments</comments>
		<pubDate>Tue, 02 Jun 2009 12:08:38 +0000</pubDate>
		<dc:creator>Amy</dc:creator>
				<category><![CDATA[State Library of North Carolina]]></category>
		<category><![CDATA[evaluation]]></category>
		<category><![CDATA[services]]></category>

		<guid isPermaLink="false">http://digital.lib.ecu.edu/collaboratory/?p=200</guid>
		<description><![CDATA[The State Library of North Carolina is beginning the process of overhauling its eNCyclopedia, a web-based information product that was developed by the State Library of North Carolina over a decade ago to assist students with frequently asked questions about North Carolina history, culture, and society. It has since expanded to include other topics about [...]]]></description>
			<content:encoded><![CDATA[<p>The <a href="http://statelibrary.ncdcr.gov/index.html" target="_blank">State Library of North Carolina</a> is beginning the process of overhauling its eNCyclopedia, a web-based information product that was developed by the State Library of North Carolina over a decade ago to assist students with frequently asked questions about North Carolina history, culture, and society.  It has since expanded to include other topics about which the State Library frequently receives questions. Even in its current state, it is one of the most frequently used products on our website. (It may be viewed online at <a href="http://statelibrary.ncdcr.gov/nc/cover.htm">http://statelibrary.ncdcr.gov/nc/cover.htm</a>.)</p>
<p>Content, appearance, and functionality are all being addressed in the overhaul, which is planned to begin this summer and continue for the next year or so. Changes will be prioritized based on feedback from users. We&#8217;re hoping to spread the word about the survey, and so I am posting about it here (although it may be slightly off topic) in hopes that readers will (1) take the survey and (2) share the survey with others, especially K12 and undergraduate educators and students. By filling out the brief online survey about interests or information needs as they relate to North Carolina, we hope it will help to improve the eNCyclopedia.</p>
<p>Separate surveys have been developed for adults and for students.</p>
<ul>
<li> The main survey, for researchers, librarians, educators and other adults may be found online at <a href="http://tinyurl.com/ncency">http://tinyurl.com/ncency</a>.</li>
<li> The survey for students is available at <a href="http://tinyurl.com/ncstudent">http://tinyurl.com/ncstudent</a>.</li>
</ul>
<p>The surveys will be open through <strong>Sunday, June 21, 2009</strong>. If you have any questions, please do not hesitate to contact Michelle Czaikowski at the State Library (<a href="mailto:Michelle.Czaikowski@ncdcr.gov">Michelle.Czaikowski@ncdcr.gov</a>).</p>
]]></content:encoded>
			<wfw:commentRss>http://digital.lib.ecu.edu/collaboratory/?feed=rss2&amp;p=200</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Novel Usability Techniques</title>
		<link>http://digital.lib.ecu.edu/collaboratory/?p=157</link>
		<comments>http://digital.lib.ecu.edu/collaboratory/?p=157#comments</comments>
		<pubDate>Tue, 21 Apr 2009 17:05:53 +0000</pubDate>
		<dc:creator>Gretchen</dc:creator>
				<category><![CDATA[ECU]]></category>
		<category><![CDATA[evaluation]]></category>

		<guid isPermaLink="false">http://digital.lib.ecu.edu/collaboratory/?p=157</guid>
		<description><![CDATA[Last Friday I took advantage of the Library&#8217;s once-per-semester Game Night* to try out an interesting usability technique I heard about somewhere.** It basically involves writing a few different tasks or questions on slips of paper (1 per slip), putting them in a jar or box, then asking the user to pull one out and [...]]]></description>
			<content:encoded><![CDATA[<p>Last Friday I took advantage of the Library&#8217;s once-per-semester Game Night* to try out an interesting usability technique I heard about somewhere.** It basically involves writing a few different tasks or questions on slips of paper (1 per slip), putting them in a jar or box, then asking the user to pull one out and either complete the task or answer the question. For their trouble they get some small token, like a piece of candy, or when I tried it out, a home-baked cookie (okay, from a bag mix, but I made like 5 dozen!). When I originally heard about it, the tester placed themselves outside the library cafe; I set up at the Game Night next to the pizza.</p>
<p>The results were interesting. <span id="more-157"></span>First my user base was different than what I think I&#8217;ve gotten in other types of feedback (more undergraduates, more diverse range of disciplines studied), but also more controlled (the type of undergraduate interested in playing video games and getting free pizza!). During the course of the night I got about 35 takers. While they didn&#8217;t seem to engage with the site in the same way they would in a more controlled setting, it was interesting to get their more casual, off-the-cuff responses. I found that we definitely need to rethink the way we are presenting the tagging/commenting feature, and it was sort of interesting to hear the various explanations of what they thought the purpose of digital collections was (a lot of responses included &#8220;images&#8221;, some thought the site was of things that were &#8220;no longer in the library&#8221;, others thought they were digitized versions of the art exhibits that are put up in the library on a regular basis). </p>
<p>All in all, I think I learned some good info, and I might try it again in the fall, but this time set up during the course of normal day in the lobby, near the coffee shop and see what happens.</p>
<p>At any rate, I thought this might be a good forum for sharing any interesting results of testing, in way to continue some of the conversation from <a href="http://digital.lib.ecu.edu/collaboratory/?p=142">Jill&#8217;s earlier post</a> (although her&#8217;s of course explore more broadly the idea of evaluation).</p>
<p>* Once per semester the library opens late on a Friday, sets up a couple of video game stations with things like Guitar Hero, Mario Kart, etc. and supplies free pizza and drinks. It&#8217;s supposed to be a way to get more students into the library and create a sense of community&#8230;<br />
**For the life of me, I can&#8217;t remember where I heard about this. Has anyone else heard of anything like this? I&#8217;d like to give credit where it is due</p>
]]></content:encoded>
			<wfw:commentRss>http://digital.lib.ecu.edu/collaboratory/?feed=rss2&amp;p=157</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Evaluation of Digital Collections</title>
		<link>http://digital.lib.ecu.edu/collaboratory/?p=142</link>
		<comments>http://digital.lib.ecu.edu/collaboratory/?p=142#comments</comments>
		<pubDate>Fri, 03 Apr 2009 17:59:56 +0000</pubDate>
		<dc:creator>Jill Katte</dc:creator>
				<category><![CDATA[digitization]]></category>
		<category><![CDATA[economy]]></category>
		<category><![CDATA[evaluation]]></category>
		<category><![CDATA[assessment]]></category>
		<category><![CDATA[impact]]></category>
		<category><![CDATA[measurement]]></category>
		<category><![CDATA[use]]></category>

		<guid isPermaLink="false">http://digital.lib.ecu.edu/collaboratory/?p=142</guid>
		<description><![CDATA[One of my goals for this spring is to develop an evaluation plan for our digital collections program. Currently, we report how much new content we publish on an annual basis, and we track web server statistics (see Sean Aery&#8217;s excellent Assessment posts on the Duke Digital Collections blog). Both of these activities certainly are [...]]]></description>
			<content:encoded><![CDATA[<p><a href="http://library.duke.edu/digitalcollections/adaccess.T0589/pg.1/"><img class="alignright" src="http://library.duke.edu/digitalcollections/images/adaccess/T/T05/T0589/T0589-thm.jpeg" alt="Seeing Dollar Signs" width="110" height="150" /></a>One of my goals for this spring is to develop an evaluation plan for our digital collections program. Currently, we report how much new content we publish on an annual basis, and we track web server statistics (see Sean Aery&#8217;s excellent <a href="http://library.duke.edu/blogs/digital-collections/category/assessment/">Assessment posts on the Duke Digital Collections blog</a>). Both of these activities certainly are important, but what conclusions can we draw from these statistics? Do they really tell us whether our collections are being used in research, teaching, and learning on campus and beyond?<span id="more-142"></span></p>
<p>Merrilee Proffitt and Jennifer Schaffner wrote:</p>
<blockquote><p>Although we need evidence of the impact of digitization and the unique collections themselves, quantitative metrics aren&#8217;t enough. We must make sure libraries and archives both measure use of special collections and work with faculty to demonstrate their value for excellent research.&#8221; (RLG Programs 2008: <a href="http://www.oclc.org/programs/publications/reports/2008-04.pdf">The Impact of Digitizing Special Collections on Teaching and Scholarship</a> [PDF], p. 7. )</p></blockquote>
<p>How can we measure the &#8220;impact&#8221; of our digital collections? What uses are most important to us? What are the best methods for documenting them? Surveys? Case studies? Interviews? How would we know these uses were taking place, especially in the classroom? Could we use citation analysis somehow? Would citation analysis miss some innovative uses of our collections, like mashups or digital art?</p>
<p>What about evaluation of internal processes in digital collection-building? Do you keep track of the average time and cost to build a digital collection? Average time and cost per item? One interesting idea for documentation and evaluation of internal workflows is the <a href="http://www2.lib.virginia.edu/bsc/index.html">Balanced Scorecard</a> management tool in use at University of Virginia Libraries. Could we adapt a model like this for digitization initiatives?</p>
]]></content:encoded>
			<wfw:commentRss>http://digital.lib.ecu.edu/collaboratory/?feed=rss2&amp;p=142</wfw:commentRss>
		<slash:comments>7</slash:comments>
		</item>
	</channel>
</rss>
