search issueshttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues2019-11-28T08:55:49Zhttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/128Explicitly define mapping when synchronizing schemata2019-11-28T08:55:49ZGradl, TobiasExplicitly define mapping when synchronizing schemata- Disable dynamic?!
*(from redmine: issue id 511, created on 2018-01-22tgradl, closed on 2018-01-24)*- Disable dynamic?!
*(from redmine: issue id 511, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/127Implement OAI-PMH offline crawling/indexing2019-11-28T08:55:48ZGradl, TobiasImplement OAI-PMH offline crawling/indexing- Refactor OAIPMH / BaseXML processing services
- Introduce a generic online processing service?
- How could the generic xml file processing service include the oaipmh
specific metadata?
*(from redmine: issue id 510, created ...- Refactor OAIPMH / BaseXML processing services
- Introduce a generic online processing service?
- How could the generic xml file processing service include the oaipmh
specific metadata?
*(from redmine: issue id 510, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/126Implement crawls as persisted entity2019-11-28T08:55:46ZGradl, TobiasImplement crawls as persisted entity- Easier CRUD
- Relation to any other object persisted with crawl
*(from redmine: issue id 509, created on 2018-01-22tgradl, closed on 2018-01-24)*- Easier CRUD
- Relation to any other object persisted with crawl
*(from redmine: issue id 509, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/125Migrate/implement resource consumption service2019-11-28T08:55:45ZGradl, TobiasMigrate/implement resource consumption service.
*(from redmine: issue id 508, created on 2018-01-22tgradl, closed on 2018-01-24)*.
*(from redmine: issue id 508, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/124Implement crawl state listener2019-11-28T08:55:44ZGradl, TobiasImplement crawl state listener- monitor crawls and update their status on error/complete
- hold state info on queue/progressing internally
*(from redmine: issue id 507, created on 2018-01-22tgradl, closed on 2018-01-24)*- monitor crawls and update their status on error/complete
- hold state info on queue/progressing internally
*(from redmine: issue id 507, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/123Rework GS crawl concept2019-11-28T08:55:43ZGradl, TobiasRework GS crawl concept- how to relate with index and schema?
- Determine, when reindexing needs to be done and which crawl data to
reevaluate
*(from redmine: issue id 506, created on 2018-01-22tgradl, closed on 2018-01-24)*- how to relate with index and schema?
- Determine, when reindexing needs to be done and which crawl data to
reevaluate
*(from redmine: issue id 506, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/122Logically connect datasources and schemas2019-11-28T08:55:42ZGradl, TobiasLogically connect datasources and schemas- what do we import?
- do we create ‘dummy’ schema entries?
- how are connection manifested?
*(from redmine: issue id 505, created on 2018-01-22tgradl, closed on 2018-01-24)*- what do we import?
- do we create ‘dummy’ schema entries?
- how are connection manifested?
*(from redmine: issue id 505, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/121Reimplement cleaner version of datasource management dialogs2019-11-28T08:55:41ZGradl, TobiasReimplement cleaner version of datasource management dialogsd
*(from redmine: issue id 504, created on 2018-01-22tgradl, closed on 2018-01-24)*d
*(from redmine: issue id 504, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/120Move model to MongoDB2019-11-28T08:55:39ZGradl, TobiasMove model to MongoDBThe model in ES is actually ok, but backend access and (emergency)
administration is not so easy
*(from redmine: issue id 503, created on 2018-01-22tgradl, closed on 2018-01-24)*The model in ES is actually ok, but backend access and (emergency)
administration is not so easy
*(from redmine: issue id 503, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/119Consume ScheReg API for schemata consumption2019-11-28T08:55:38ZGradl, TobiasConsume ScheReg API for schemata consumptionSync and refresh filesystem
*(from redmine: issue id 500, created on 2018-01-22tgradl, closed on 2018-01-24)*Sync and refresh filesystem
*(from redmine: issue id 500, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/118Implement new metamodel for schemata/mappings2019-11-28T08:55:37ZGradl, TobiasImplement new metamodel for schemata/mappingsSave and load from filesystem ->physical independence of ScheReg
being live
*(from redmine: issue id 499, created on 2018-01-22tgradl, closed on 2018-01-24)*Save and load from filesystem ->physical independence of ScheReg
being live
*(from redmine: issue id 499, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/117Recreate/migrate collection registry sync behavior2019-11-28T08:55:36ZGradl, TobiasRecreate/migrate collection registry sync behaviortry to reuse functionality
*(from redmine: issue id 498, created on 2018-01-22tgradl, closed on 2018-01-24)*try to reuse functionality
*(from redmine: issue id 498, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/114Migrate security from BaseController to Filter/Interceptor2019-11-28T08:55:32ZGradl, TobiasMigrate security from BaseController to Filter/Interceptor.
*(from redmine: issue id 495, created on 2018-01-22tgradl, closed on 2018-01-24)*.
*(from redmine: issue id 495, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/113Cleanup unused dependencies2019-11-28T08:55:31ZGradl, TobiasCleanup unused dependenciesThere are some dependencies that I do not remember the use of ->test
with Tomcat, however!
*(from redmine: issue id 494, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #496
* duplicates #489There are some dependencies that I do not remember the use of ->test
with Tomcat, however!
*(from redmine: issue id 494, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #496
* duplicates #4893.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/112Remove relational DB completely and migrate data to ES2019-11-28T08:55:29ZGradl, TobiasRemove relational DB completely and migrate data to ESuse spring-data-elasticsearch
*(from redmine: issue id 493, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #496use spring-data-elasticsearch
*(from redmine: issue id 493, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #4963.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/111Rework indexing strategy2019-11-28T08:55:28ZGradl, TobiasRework indexing strategyThis is required due to changes in ES 2.0
https://www.elastic.co/guide/en/elasticsearch/plugins/2.0/plugins-delete-by-query.html
- One index per mapping might be an option
- Saving indexed data to the filesystem in order to fast r...This is required due to changes in ES 2.0
https://www.elastic.co/guide/en/elasticsearch/plugins/2.0/plugins-delete-by-query.html
- One index per mapping might be an option
- Saving indexed data to the filesystem in order to fast reindex is
another option
*(from redmine: issue id 492, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #4913.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/110Upgrade to recent ES2019-11-28T08:55:26ZGradl, TobiasUpgrade to recent EStest the more recent elastic search versions
*(from redmine: issue id 491, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #496
* relates #492test the more recent elastic search versions
*(from redmine: issue id 491, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #496
* relates #4923.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/109Reuse wikipedia handling functionality from Cosmotool2019-11-28T08:55:25ZGradl, TobiasReuse wikipedia handling functionality from Cosmotoolsplitter, import and indexing
*(from redmine: issue id 490, created on 2018-01-22tgradl)*splitter, import and indexing
*(from redmine: issue id 490, created on 2018-01-22tgradl)*backlogGradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/108Remove old packages and dependencies2019-11-28T08:55:24ZGradl, TobiasRemove old packages and dependencies- model, federation etc.
- just remove and see what happens
*(from redmine: issue id 489, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #496
* duplicates #494- model, federation etc.
- just remove and see what happens
*(from redmine: issue id 489, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #496
* duplicates #4943.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/107Query only configured indexes2019-11-28T08:55:23ZGradl, TobiasQuery only configured indexesnot .marvel, geosearch etc.
*(from redmine: issue id 195, created on 2018-01-22tgradl, closed on 2018-01-22)*
* Relations:
* relates #193not .marvel, geosearch etc.
*(from redmine: issue id 195, created on 2018-01-22tgradl, closed on 2018-01-22)*
* Relations:
* relates #1932.2Gradl, TobiasGradl, Tobias