source: SMC4LRT/chapters/Data.tex @ 2703

\chapter{Analysis of the data landscape}
\label{ch:data}
This section gives an overview of existing standards and formats for metadata and content annotations in the field of Language Resources and Technology together with a description of their characteristics and their respective usage in the projects and initiatives.


\section{Metadata Formats}


\subsection{CMD-Framework}

\begin{center}
  \begin{tabular}{ l | r }
    \hline
created & 2013-01-26 \\ \hline
Profiles & 87 \\
Components & 2904 \\
distinct Components & 542 \\
Elements & 5754 \\
distinct Elements & 1505 \\
distinct DatCats & 436 \\
Elements with DatCats & 1183 \\
Elements without DatCats & 323 \\
ratio of elements without DatCats & 21.46 \% \\
available Concepts & 893 \\
used Concept & 474 \\
blind Concepts (not in public ISOcat) & 190 \\
Concepts not used in CMD & 539 \\
    \hline
  \end{tabular}
\end{center}

\todoin{Collect number about CMD-Framework (profiles, datcats) + historical development}

\todoin{Collect numbers about CMD records (collections, used profiles, ...) in historical perspective}


\subsection{Dublin Core + OLAC}

DC, OLAC

DublinCore Resource Types\furl{http://dublincore.org/documents/resource-typelist/}

\subsection{TEI / teiHeader}
 TEI/teiHeader/ODD,

\subsection{ISLE/IMDI}
 
\subsection{MODS/METS}

\subsection{Europeana Data Model - EDM}


\subsection{Other}

OAI-ORE - is this a schema?



\section{Content/Annotation Formats}

CHILDES, TEI, EAF!
(CES/XCES)
Open Annotation Collaboration (OAC)\footnote{\url{http://openannotation.org/}}

[LAF] Linguistic Annotation Framework



\section{Ontologies, Controlled Vocabularies, Reference Data, Authority Files}
\label{refdata}

Based on popular demand, the work on reference data for the SSH-community should cover at least the following dimensions (with tentative denominations of corresponding existing vocabularies):

\begin{itemize}
\item Data Categories / Concepts - ISOcat
\item Languages - ISO-639
\item Countries - country codes
\item Persons - GND, VIAF
\item Organizations - GND, VIAF
\item Schlagwörter/Subjects - GND, LCSH
\item Resource Typology - 
\end{itemize}

AAT - international Architecture and Arts Thesaurus
GND - Gemeinsame Norm Datei
GTAA - Gemeenschappelijke Thesaurus Audiovisuele Archieven (Common Thesaurus [for] Audiovisual Archives)
VIAF - Virtual International Authority File

Other related relevant activities and initiatives

A broader collection of related initiatives can be found at the German National Library website:
\furl{http://www.dnb.de/DE/Standardisierung/LinksAFS/linksafs_node.html}
FRBR - Functional Requirements for Bibliographic Records 
RDA - Resource Description and Access
http://metadaten-twr.org/ - Technology Watch Report: Standards in Metadata and Interoperability (last entry from 2011)
At MPDL, within the escidoc publication platform there seems to be (work  on) a service (since 2009 !) for controlled vocabularies: \furl{http://colab.mpdl.mpg.de/mediawiki/Control_of_Named_Entities}
Entity Authority Tool Set - a web application for recording, editing, using and displaying authority information about entities – developed at the New Zealand Electronic Text Centre (NZETC).
http://eats.readthedocs.org/en/latest/


\subsection{ISOcat - Data Category Registry}

ISO12620

\subsection{Classification Schemes, Taxonomies }
LCSH, DDC


\subsection{Other controlled Vocabularies}
Tagsets: STTS
Language codes ISO-639-1

\subsection{Domain Ontologies, Vocabularies}
Organization-Lists
LT-World !?



\section{LRT Metadata Catalogs/Collections}

\todoin{Overview of catalogs, name, since, #providers, #resources}

\todoin{[DFKI/LT-World]  - collection or ontology}

\subsection{CMDI}
collections, profiles/Terms, ResourceTypes!

\subsection{OLAC}

\subsection{LAT, TLA}
Language Archiving Technology, now The Language Archive - provided by Max Planck Insitute for Psycholinguistics \footnote{\url{http://www.mpi.nl/research/research-projects/language-archiving-technology}}

\subsection{META-NET}


\subsection{ELRA}

\subsection{Other}


\begin{description}
\item[LDC]  Linguistic Data Consortium 
\item[OTA LR] Archiving Service provided by Oxford Text Archive \url{http://ota.oucs.ox.ac.uk/}
\end{description}

\section{Other Metadata Catalogs/Collections}

Digital Libraries
\subsubsection{(Digital) Libraries}


General (Libraries, Federations):

\begin{description}
\item[OCLC] \url{http://www.oclc.org}
    world's biggest Library Federation
\item[LoC] Library of Congress \url{http://www.loc.gov}
\item[EU-Lib] European Library \url{http://www.theeuropeanlibrary.org/portal/organisation/handbook/accessing-collections\_ en.htm}
\item[europeana] virtual European library - cross-domain portal \url{http://www.europeana.eu/portal/}
\end{description}




\section{Summary}

In this chapter, we gave an overview of the existing formats and dataset in the broad context of Language Resources and Technology