GGBN specific configuration - Revision history

PatriciaKelbert: /* Add new statistics charts */

2016-02-11T09:49:45Z

Add new statistics charts

← Older revision		Revision as of 11:49, 11 February 2016
Line 367:		Line 367:
	</pre>		</pre>

			Here you go !

	[[File:repoStats.png]]		[[File:repoStats.png]]

PatriciaKelbert: /* Add new statistics charts */

2016-02-11T09:49:01Z

Add new statistics charts

← Older revision		Revision as of 11:49, 11 February 2016
Line 307:		Line 307:
	Add in the "Global" tab two new divs (with new ids)		Add in the "Global" tab two new divs (with new ids)
	<pre>		<pre>
	<div class="col-lg-6" id="~~chartrep1~~" style="width: 500px; height: 400px;"></div>		<div class="col-lg-6" id="chartrepo1" style="width: 500px; height: 400px;"></div>
	<div class="col-lg-6" id="~~chartrep2~~" style="width: 500px; height: 400px;"></div>		<div class="col-lg-6" id="chartrepo2" style="width: 500px; height: 400px;"></div>
	</pre>		</pre>
	Edit the Javascript part: copy the code for the $kindofunitdatasamples and edit it		Edit the Javascript part: copy the code for the $kindofunitdatasamples and edit it
Line 366:		Line 366:
	<?php endif;?>		<?php endif;?>
	</pre>		</pre>


			[[File:repoStats.png]]

PatriciaKelbert: /* Add new statistics charts */

2016-02-11T09:45:04Z

Add new statistics charts

← Older revision		Revision as of 11:45, 11 February 2016
Line 226:		Line 226:
	<pre>		<pre>
	try {		try {
	$repositoriesvouchers = $this->getRepositories( $f, '~~samples~~' );		$repositoriesvouchers = $this->getRepositories( $f, 'vouchers' );
	} catch ( \Solarium\Exception\HttpException $e ) {		} catch ( \Solarium\Exception\HttpException $e ) {
	Yii::$app->mailer->compose ()->setFrom ( Yii::$app->params ['noreplyMail'] )->setTo ( Yii::$app->params ['feedbackMail'] )->setSubject ( 'Error occured' )->setTextBody ( $e )->send ();		Yii::$app->mailer->compose ()->setFrom ( Yii::$app->params ['noreplyMail'] )->setTo ( Yii::$app->params ['feedbackMail'] )->setSubject ( 'Error occured' )->setTextBody ( $e )->send ();

PatriciaKelbert: /* Add new statistics charts */

2016-02-11T08:35:36Z

Add new statistics charts

@@ Line 301: / Line 301: @@
 					return "[" . implode ( ",", $data ) . "]";
+	}
 </pre>

PatriciaKelbert: /* Add new statistics charts */

2016-02-11T08:29:39Z

Add new statistics charts

← Older revision		Revision as of 10:29, 11 February 2016
Line 216:		Line 216:
	=Add new statistics charts=		=Add new statistics charts=
	Example: show overview for the repositories (with filters). The repository will '''not''' be an active filter in the global statistics tab.		Example: show overview for the repositories (with filters). The repository will '''not''' be an active filter in the global statistics tab.
			Edit the file <code>StatsController.php</code>.

	In the function actionIndex, add following variables:		In the function actionIndex, add following variables:
	<pre>		<pre>

PatriciaKelbert: /* Add new statistics charts */

2016-02-11T08:29:02Z

Add new statistics charts

← Older revision		Revision as of 10:29, 11 February 2016
Line 215:		Line 215:

	=Add new statistics charts=		=Add new statistics charts=
			Example: show overview for the repositories (with filters). The repository will '''not''' be an active filter in the global statistics tab.
			In the function actionIndex, add following variables:
			<pre>
			$repositoriessamples = [ ];
			$repositoriesvouchers = [ ];
			</pre>
			and the calls to
			<pre>
			try {
			$repositoriesvouchers = $this->getRepositories( $f, 'samples' );
			} catch ( \Solarium\Exception\HttpException $e ) {
			Yii::$app->mailer->compose ()->setFrom ( Yii::$app->params ['noreplyMail'] )->setTo ( Yii::$app->params ['feedbackMail'] )->setSubject ( 'Error occured' )->setTextBody ( $e )->send ();
			return $this->render ( '/site/error', [
			"name" => "Oooops",
			"message" => "The SOLR instance seems to be gone.",
			"error" => $e
			] );
			}

			try {
			$repositoriessamples = $this->getRepositories ( $f, 'samples' );
			} catch ( \Solarium\Exception\HttpException $e ) {
			Yii::$app->mailer->compose ()->setFrom ( Yii::$app->params ['noreplyMail'] )->setTo ( Yii::$app->params ['feedbackMail'] )->setSubject ( 'Error occured' )->setTextBody ( $e )->send ();
			return $this->render ( '/site/error', [
			"name" => "Oooops",
			"message" => "The SOLR instance seems to be gone.",
			"error" => $e
			] );
			}
			</pre>
			and also
			<pre>
			'repositoriessamples' => $repositoriessamples,
			'repositoriesvouchers' => $repositoriesvouchers,
			</pre> to the render list

			Create the function <code>getRepositories</code> (copy the getKindofunit method and edit the name of the SOLR facet).
			<pre>
			public function getRepositories($filter, $type) {
			// Yii::info ( "getKindofunit " . $filter );
			$config = SOLRQueryManager::getConfigStats ();
			// create a client instance
			$client = new Solarium\Client ( $config );
			// set the adapter to http
			$client->setAdapter ( 'Solarium\Core\Client\Adapter\Http' );

			// get a select query instance
			$query = $client->createSelect ();
			// set fields to fetch (this overrides the default setting 'all fields')
			$query->setFields ( [
			"[]"
			] );

			$q = "sampletype:*";
			if ($type === "vouchers")
			$q = "sampletype:(culture OR specimen OR unknown OR eVoucher)";
			if ($type === "samples")
			$q = "-sampletype:(culture OR specimen OR unknown OR eVoucher)";
			if (! empty ( $filter ))
			$q .= " AND " . $filter;
			$q = str_replace ( "registry", "institution", $q );
			$query->setQuery ( $q );


			// get the facetset component
			$facetSet = $query->getFacetSet ();
			$facetSet->setLimit ( - 1 );
			$facetSet->setMinCount ( 1 );
			$facetSet->setSort ( "false" );

			// create a facet field instance and set options
			$facetSet->createFacetField ( "institution" )->setField ( "institution" );
			// this executes the query and returns the result
			$raw_response = $client->select ( $query );

			$result = $raw_response->getFacetSet ()->getFacet ( "institution" );
			$data = [ ];
			foreach ( $result as $doc => $count ) {
			$data [] = '["' . $doc . ' (' . $count . ')",' . $count . ']';
			// Yii::info("SUBLIST: ".$doc);
			}

			return "[" . implode ( ",", $data ) . "]";
			}
			</pre>

PatriciaKelbert at 08:18, 11 February 2016

2016-02-11T08:18:12Z

← Older revision		Revision as of 10:18, 11 February 2016
Line 213:		Line 213:

	Note: if you have old links in the search results, delete the content of the data folder of SOLR, and run 2 times the crawl function (exact same line).		Note: if you have old links in the search results, delete the content of the data folder of SOLR, and run 2 times the crawl function (exact same line).

			=Add new statistics charts=

PatriciaKelbert: /* SOLR core for search within a website */

2016-02-10T12:22:13Z

SOLR core for search within a website

← Older revision		Revision as of 14:22, 10 February 2016
Line 211:		Line 211:

	Restart the SOLR instance.		Restart the SOLR instance.

			Note: if you have old links in the search results, delete the content of the data folder of SOLR, and run 2 times the crawl function (exact same line).

PatriciaKelbert: /* SOLR core for search within a website */

2016-02-10T11:38:53Z

SOLR core for search within a website

← Older revision		Revision as of 13:38, 10 February 2016
Line 209:		Line 209:

	Stop the SOLR instance for a short moment on the SOLR server, copy the local nutch/data files on the server (also in nutch data, you can choose to delete the old files first, then copy, then check the writing/reading rights in this data folder).		Stop the SOLR instance for a short moment on the SOLR server, copy the local nutch/data files on the server (also in nutch data, you can choose to delete the old files first, then copy, then check the writing/reading rights in this data folder).

			Restart the SOLR instance.

PatriciaKelbert: /* SOLR core for search within a website */

2016-02-10T11:38:39Z

SOLR core for search within a website

← Older revision		Revision as of 13:38, 10 February 2016
Line 201:		Line 201:

	=SOLR core for search within a website=		=SOLR core for search within a website=
			Install apache-nutch (tested with apache-nutch-1.10, https://wiki.apache.org/nutch/NutchTutorial). You need a local SOLR instance (easier that way).
			Configure in the folder "urls" the urls to seed (here http://data.ggbn.org/)
			You need another Core on the SOLR server (called nutch).

			Go in the installed folder and run:
			bin/crawl -i -D solr.server.url=http://localhost:8080/solr/nutch urls/ TestCrawl1002/ 2

			Stop the SOLR instance for a short moment on the SOLR server, copy the local nutch/data files on the server (also in nutch data, you can choose to delete the old files first, then copy, then check the writing/reading rights in this data folder).