Data Quality Toolkit - User contributions [en]

Bugs & Features

2012-11-15T15:08:46Z

JanaHoffmann:

== Bugs ==

Please, report any bugs encountered during testing. Describe the bug so that also provider can understand the problem.

{| {{table}}
| align="center" style="background:#f0f0f0;"|'''#Issue No.'''
| align="center" style="background:#f0f0f0;"|'''Name'''
| align="center" style="background:#f0f0f0;"|'''Description'''
| align="center" style="background:#f0f0f0;"|'''Assigned to'''
| align="center" style="background:#f0f0f0;"|'''@Reporting date'''
| align="center" style="background:#f0f0f0;"|'''Status'''
| align="center" style="background:#f0f0f0;"|'''Comments'''
|-
|#1||Server Timeout?||<nowiki><!--<Annotations>
<Annotation>

<Context>OpenUP</Context>

<ISODateTime>2012-11-15T10:29:09.180Z</ISODateTime>

<MethodOrAgent>ODIS V0.1</MethodOrAgent>

<Type>Warning</Type>

<Message>Access denied to media object.</Message>

<Suggestion></Suggestion>

</Annotation>

</Annotations>
</nowiki>
||Peer Schwirtz BGBM||@unknown||open|| ||
|-
|}

== Features ==

Please report any features, which should be implemented. Features are defined as real improvement/ new functionalities of the current tool.

{| {{table}}
| align="center" style="background:#f0f0f0;"|'''#Feature No.'''
| align="center" style="background:#f0f0f0;"|'''Name'''
| align="center" style="background:#f0f0f0;"|'''Description'''
| align="center" style="background:#f0f0f0;"|'''@Reporting date'''
| align="center" style="background:#f0f0f0;"|'''Status'''
| align="center" style="background:#f0f0f0;"|'''Comments'''
|-
|#1||Summary Report ||Produce summarized export of test results (human readable), e.g. tested items: 100; bug No. 1: 50 of 100 items wrong format, bug No. 2: 20 of 100 items scientific name not recognized, etc. ||15 Nov 12||suggested feature||This would allow providers/ coordinators to assess the data quality of a provider in a better way.||
|-
|#2||Mineralogy||Quality check of mineralogical datasources should also be possible. Example: Prague (NM) ||15 Nov 12||suggested feature||||
|-
|#3||List of problematic IDs|| It would be good to get a list of IDs for which problems in the quality check were discovered. Maybe this could be listed by rule and included in feature #1. ||15 Nov 12||suggested feature||||
|-
|#4||Filter by range of IDs|| Search by ranges of IDs, e.g. 1-10 not only 1;2;3;... ||15 Nov 12||suggested feature||||
|}

Bugs & Features

2012-11-15T14:59:09Z

JanaHoffmann:

Testing

2012-11-15T14:03:49Z

JanaHoffmann:

The testing based on a spreadsheet which based on the following structur:

{| {{table}}
| align="center" style="background:#f0f0f0;"|'''Provider Acronym'''
| align="center" style="background:#f0f0f0;"|'''Source Acronym'''
| align="center" style="background:#f0f0f0;"|'''Datasource URL'''
| align="center" style="background:#f0f0f0;"|'''Filter'''
| align="center" style="background:#f0f0f0;"|'''Lists (Rules)'''
| align="center" style="background:#f0f0f0;"|'''Issue report'''
| align="center" style="background:#f0f0f0;"|'''@Testing date'''
| align="center" style="background:#f0f0f0;"|'''Tester Acronym'''
| align="center" style="background:#f0f0f0;"|'''Status'''
|-
|
|-
| UH||luomus_botany||http://pontikka.fmnh.helsinki.fi/biocase/pywrapper.cgi?dsa=luomus_botany||A*/B*/C*||1,2,3,4,5,6,7(Col,Fauna),8,9,10,11,12 || Not Found: Pisum Ochrus, Clematis cirrhosa, Ranunculus chaerophyllos, Lamium garganicum, Lotus recta||@unkown||PS||open||
|-
| ETI||ZMNS||http://openup.etibioinformatics.nl/biocase/pywrapper.cgi?dsa=ZMNS
||A*||2,5,6,9,10,13,15,3,4|| FileURI: Access denied to media object (bug #1); Format: JPEG instead of image/jpeg||15 Nov 12||JH||open: contact provider||
|-
|}

----

To get an overview of all OpenUp! providers: http://edit.africamuseum.be/biocasemonitor/

Spreadsheet:

*[[File:DQT testing.xlsx|current]]

Bugs & Features

2012-11-15T13:17:14Z

JanaHoffmann:

== Bugs ==

Please, report any bugs encountered during testing. Describe the bug so that also provider can understand the problem.

{| {{table}}
| align="center" style="background:#f0f0f0;"|'''#Issue No.'''
| align="center" style="background:#f0f0f0;"|'''Name'''
| align="center" style="background:#f0f0f0;"|'''Description'''
| align="center" style="background:#f0f0f0;"|'''Assigned to'''
| align="center" style="background:#f0f0f0;"|'''@Reporting date'''
| align="center" style="background:#f0f0f0;"|'''Status'''
| align="center" style="background:#f0f0f0;"|'''Comments'''
|-
|#1||Server Timeout?||<nowiki><!--<Annotations>
<Annotation>

<Context>OpenUP</Context>

<ISODateTime>2012-11-15T10:29:09.180Z</ISODateTime>

<MethodOrAgent>ODIS V0.1</MethodOrAgent>

<Type>Warning</Type>

<Message>Access denied to media object.</Message>

<Suggestion></Suggestion>

</Annotation>

</Annotations>
</nowiki>
||Peer Schwirtz BGBM||@unknown||open|| ||
|}

== Features ==

Please report any features, which should be implemented. Features are defined as real improvement/ new functionalities of the current tool.

{| {{table}}
| align="center" style="background:#f0f0f0;"|'''#Feature No.'''
| align="center" style="background:#f0f0f0;"|'''Name'''
| align="center" style="background:#f0f0f0;"|'''Description'''
| align="center" style="background:#f0f0f0;"|'''@Reporting date'''
| align="center" style="background:#f0f0f0;"|'''Status'''
| align="center" style="background:#f0f0f0;"|'''Comments'''
|-
|#1||Summary Report ||Produce summarized export of test results (human readable), e.g. tested items: 100; bug No. 1: 50 of 100 items wrong format, bug No. 2: 20 of 100 items scientific name not recognized, etc. ||15 Nov 12||suggested feature||This would allow providers/ coordinators to assess the data quality of a provider in a better way.||
|-
|}

Bugs & Features

2012-11-15T13:12:27Z

JanaHoffmann:

Home

2012-11-15T13:11:18Z

JanaHoffmann:

http://services.bgbm.org/DataQualityToolkit/

== Data Quality Toolkit ==

The Data Quality Toolkit is an open web-based application for OpenUp! data providers and BioCASE (http://www.biocase.org/products/provider_software/) providers in general performing data quality checks on their data. The system integrates a set of distributed quality services into a single and consistent user interface, thereby hiding the complexity of the individual services. In particular, the Quality Toolkit integrates the zoological and botanical quality services developed by WP 4 and WP 5 as well as the data integrity services developed within WP 2.

The Data Quality Toolkit operates directly on a given BioCASE provider service installation. It pages through a subset of records (collection units) specified by the given user query (e.g. for a specific genus) and applies a set of user-selectable quality testing procedures.

The result comes as an annotated ABCD-document containing all unit-records with one or more quality problems. Annotations explaining the problems are directly placed in the form of structured comments next to the elements they refer to. Using ABCD as a reporting format has two advantages over a proprietary format: 1) the connection between data and their annotations is directly visible and does not have to be “explained” using a different structure and 2) using ABCD opens opportunities for future developments of software components, which automatically re-inserts annotated data into provider databases.

Bugs & Features

2012-11-15T13:10:25Z

JanaHoffmann:

Bugs & Features

2012-11-15T13:09:23Z

JanaHoffmann:

== Bugs ==

Please report any bugs encountered during testing.

{| {{table}}
| align="center" style="background:#f0f0f0;"|'''#Issue No.'''
| align="center" style="background:#f0f0f0;"|'''Description'''
| align="center" style="background:#f0f0f0;"|'''Assigned to'''
| align="center" style="background:#f0f0f0;"|'''@Reporting date'''
| align="center" style="background:#f0f0f0;"|'''Status'''
| align="center" style="background:#f0f0f0;"|'''Comments'''
|-
|#1||
<nowiki><!--<Annotations>
<Annotation>

<Context>OpenUP</Context>

<ISODateTime>2012-11-15T10:29:09.180Z</ISODateTime>

<MethodOrAgent>ODIS V0.1</MethodOrAgent>

<Type>Warning</Type>

<Message>Access denied to media object.</Message>

<Suggestion></Suggestion>

</Annotation>

</Annotations>
</nowiki>
||Peer Schwirtz BGBM||@unknown||open|| ||
|}

== Features ==

Please report any features, which should be implemented. Features are defined as real improvement/ new functionalities of the current tool.

{| {{table}}
| align="center" style="background:#f0f0f0;"|'''#Feature No.'''
| align="center" style="background:#f0f0f0;"|'''Description'''
| align="center" style="background:#f0f0f0;"|'''@Reporting date'''
| align="center" style="background:#f0f0f0;"|'''Status'''
| align="center" style="background:#f0f0f0;"|'''Comments'''
|-
|# || ||||||||
|-
|}

Bugs & Features

2012-11-15T11:31:27Z

JanaHoffmann:

== Bugs ==

{| {{table}}
| align="center" style="background:#f0f0f0;"|'''#Issue No.'''
| align="center" style="background:#f0f0f0;"|'''Description'''
| align="center" style="background:#f0f0f0;"|'''Assigned to'''
| align="center" style="background:#f0f0f0;"|'''@Reporting date'''
| align="center" style="background:#f0f0f0;"|'''Status'''
| align="center" style="background:#f0f0f0;"|'''Comments'''
|-
|#1||
<nowiki><!--<Annotations>
<Annotation>

<Context>OpenUP</Context>

<ISODateTime>2012-11-15T10:29:09.180Z</ISODateTime>

<MethodOrAgent>ODIS V0.1</MethodOrAgent>

<Type>Warning</Type>

<Message>Access denied to media object.</Message>

<Suggestion></Suggestion>

</Annotation>

</Annotations>
</nowiki>
||Peer Schwirtz BGBM||@unknown||open|| ||
|}

== Features ==
{| {{table}}
| align="center" style="background:#f0f0f0;"|'''#Feature No.'''
| align="center" style="background:#f0f0f0;"|'''Description'''
| align="center" style="background:#f0f0f0;"|'''@Reporting date'''
| align="center" style="background:#f0f0f0;"|'''Status'''
| align="center" style="background:#f0f0f0;"|'''Comments'''
|-
|# || ||||||||
|-
|}

Bugs & Features

2012-11-15T11:30:42Z

JanaHoffmann: Created page with "== Bugs == {| {{table}} | align="center" style="background:#f0f0f0;"|'''#Issue No.''' | align="center" style="background:#f0f0f0;"|'''Description''' | align="center" style="back..."

== Bugs ==

{| {{table}}
| align="center" style="background:#f0f0f0;"|'''#Issue No.'''
| align="center" style="background:#f0f0f0;"|'''Description'''
| align="center" style="background:#f0f0f0;"|'''Assigned to'''
| align="center" style="background:#f0f0f0;"|'''@Reporting date'''
| align="center" style="background:#f0f0f0;"|'''Status'''
| align="center" style="background:#f0f0f0;"|'''Comments'''
|-
|#||||Peer Schwirtz BGBM||@unknown||open|| ||
|}

== Features ==
{| {{table}}
| align="center" style="background:#f0f0f0;"|'''#Feature No.'''
| align="center" style="background:#f0f0f0;"|'''Description'''
| align="center" style="background:#f0f0f0;"|'''@Reporting date'''
| align="center" style="background:#f0f0f0;"|'''Status'''
| align="center" style="background:#f0f0f0;"|'''Comments'''
|-
|# || ||||||||
|-
|}

MediaWiki:Sidebar

2012-11-15T11:21:55Z

JanaHoffmann:

* Navigation

** Home|Home
** Testing|Testing
** Bugs & Features| Bugs & Features

* SEARCH
** TOOLBOX
* LANGUAGES

MediaWiki:Sidebar

2012-11-15T11:21:45Z

JanaHoffmann:

* Navigation|Navigation

** Home|Home
** Testing|Testing
** Bugs & Features| Bugs & Features

* SEARCH
** TOOLBOX
* LANGUAGES

MediaWiki:Sidebar

2012-11-15T11:21:35Z

JanaHoffmann:

* Navigation

** Home|Home
** Testing|Testing
** Bugs & Features| Bugs & Features

* SEARCH
** TOOLBOX
* LANGUAGES

MediaWiki:Sidebar

2012-11-15T11:21:20Z

JanaHoffmann:

* navigation

** Home|Home
** Testing|Testing
** Bugs & Features| Bugs & Features

* SEARCH
** TOOLBOX
* LANGUAGES

MediaWiki:Sidebar

2012-11-15T11:18:52Z

JanaHoffmann:

* navigation

** Testing|Testing
** Bugs & Features| Bugs & Features

* SEARCH
** TOOLBOX
* LANGUAGES

MediaWiki:Sidebar

2012-11-15T11:18:45Z

JanaHoffmann:

* navigation

** Testing|Testing
** Bugs & Features| Bug & Features

* SEARCH
** TOOLBOX
* LANGUAGES

MediaWiki:Sidebar

2012-11-15T11:16:56Z

JanaHoffmann:

* navigation

** Testing|Testing
** Bug Tracker| Bug Tracker

* SEARCH
** TOOLBOX
* LANGUAGES

Testing

2012-11-15T11:15:16Z

JanaHoffmann:

The testing based on a spreadsheet which based on the following structur:

{| {{table}}
| align="center" style="background:#f0f0f0;"|'''Provider Acronym'''
| align="center" style="background:#f0f0f0;"|'''Source Acronym'''
| align="center" style="background:#f0f0f0;"|'''Datasource URL'''
| align="center" style="background:#f0f0f0;"|'''Filter'''
| align="center" style="background:#f0f0f0;"|'''Lists (Rules)'''
| align="center" style="background:#f0f0f0;"|'''Issue report'''
| align="center" style="background:#f0f0f0;"|'''@Testing date'''
| align="center" style="background:#f0f0f0;"|'''Tester Acronym'''
| align="center" style="background:#f0f0f0;"|'''Status'''
|-
|
|-
| UH||luomus_botany||http://pontikka.fmnh.helsinki.fi/biocase/pywrapper.cgi?dsa=luomus_botany||A*/B*/C*||1,2,3,4,5,6,7(Col,Fauna),8,9,10,11,12 || Not Found: Pisum Ochrus, Clematis cirrhosa, Ranunculus chaerophyllos, Lamium garganicum, Lotus recta||@unkown||PS||open||
|-
| ETI||ZMNS||http://openup.etibioinformatics.nl/biocase/pywrapper.cgi?dsa=ZMNS
||A*||2,5,6,9,10,13,15,3,4|| FileURI: Access denied to media object; Format: JPEG instead of image/jpeg||15 Nov 12||JH||open: contact provider||
|-
|}

----

To get an overview of all OpenUp! providers: http://edit.africamuseum.be/biocasemonitor/

Spreadsheet:

*[[File:DQT testing.xlsx|current]]

Testing

2012-11-15T10:47:29Z

JanaHoffmann:

The testing based on a spreadsheet which based on the following structur:

{| {{table}}
| align="center" style="background:#f0f0f0;"|'''Provider Acronym'''
| align="center" style="background:#f0f0f0;"|'''Source Name'''
| align="center" style="background:#f0f0f0;"|'''Datasource URL'''
| align="center" style="background:#f0f0f0;"|'''Filter'''
| align="center" style="background:#f0f0f0;"|'''Lists (Rules)'''
| align="center" style="background:#f0f0f0;"|'''Issue report'''
| align="center" style="background:#f0f0f0;"|'''Comments'''
|-
|
|-
| UH||Linnaean specimens in the Botanical Museum of the University of Helsinki ||http://pontikka.fmnh.helsinki.fi/biocase/pywrapper.cgi?dsa=luomus_botany ||A*/B*/C*||1,2,3,4,5,6,7(Col,Fauna),8,9,10,11,12 || Not Found: Pisum Ochrus, Clematis cirrhosa, Ranunculus chaerophyllos, Lamium garganicum, Lotus recta

|}

----

To get an overview of all OpenUp! providers: http://edit.africamuseum.be/biocasemonitor/

Spreadsheet:

*[[File:DQT testing.xlsx|current]]