search issueshttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues2019-11-28T08:57:25Zhttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/210Extract common functionality into search-commons library2019-11-28T08:57:25ZGradl, TobiasExtract common functionality into search-commons libraryreusable for Cosmotool and potentially other searches
*(from redmine: issue id 655, created on 2018-01-22tgradl, closed on 2018-01-24)*reusable for Cosmotool and potentially other searches
*(from redmine: issue id 655, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/205Implement online file adapter2019-11-28T08:57:19ZGradl, TobiasImplement online file adapter- dowload
- unpack / untar
- chunk
*(from redmine: issue id 643, created on 2018-01-22tgradl, closed on 2018-02-09)*- dowload
- unpack / untar
- chunk
*(from redmine: issue id 643, created on 2018-01-22tgradl, closed on 2018-02-09)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/203OaiPmhHarvester should know about record state2019-11-28T08:57:17ZGradl, TobiasOaiPmhHarvester should know about record stateTo provide size and progress
*(from redmine: issue id 641, created on 2018-01-22tgradl, closed on 2018-01-24)*To provide size and progress
*(from redmine: issue id 641, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/202Complete transparency for crawls2019-11-28T08:57:15ZGradl, TobiasComplete transparency for crawls- Crawl manager handles inquiries to threads
*(from redmine: issue id 640, created on 2018-01-22tgradl, closed on 2018-01-24)*- Crawl manager handles inquiries to threads
*(from redmine: issue id 640, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/201Have OaiPmhHarvestingService fail if response is not ListRecords2019-11-28T08:57:14ZGradl, TobiasHave OaiPmhHarvestingService fail if response is not ListRecordstypically if no good metadata prefix is used or url wrong etc.
*(from redmine: issue id 639, created on 2018-01-22tgradl, closed on 2018-01-24)*typically if no good metadata prefix is used or url wrong etc.
*(from redmine: issue id 639, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/200Implement prefix autodetection in OaiPmhCrawler / OaiPmhHarvestingService2019-11-28T08:57:13ZGradl, TobiasImplement prefix autodetection in OaiPmhCrawler / OaiPmhHarvestingServiceTry much in OaiPmhHarvestingService, only crawl related aspects
(persistence) in OaiPmhCrawler
*(from redmine: issue id 638, created on 2018-01-22tgradl, closed on 2018-01-24)*Try much in OaiPmhHarvestingService, only crawl related aspects
(persistence) in OaiPmhCrawler
*(from redmine: issue id 638, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/193Consolidate datasource info and actions under comprehensive new view2019-11-28T08:57:06ZGradl, TobiasConsolidate datasource info and actions under comprehensive new view- Crawls
- Schema info
- …
*(from redmine: issue id 631, created on 2018-01-22tgradl, closed on 2018-01-24)*- Crawls
- Schema info
- …
*(from redmine: issue id 631, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/189Implement data type handling (complete example: geo_points)2019-11-28T08:57:01ZGradl, TobiasImplement data type handling (complete example: geo_points)follow up in task 627
*(from redmine: issue id 627, created on 2018-01-22tgradl, closed on 2018-01-24)*follow up in task 627
*(from redmine: issue id 627, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/188Outdate schema definitions2019-11-28T08:57:00ZGradl, TobiasOutdate schema definitions- when changed in SR
- when mapping to GS Model changes as well!
- Not automations right now
*(from redmine: issue id 624, created on 2018-01-22tgradl, closed on 2018-01-24)*- when changed in SR
- when mapping to GS Model changes as well!
- Not automations right now
*(from redmine: issue id 624, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/187Refactor index mapping generation / conversion2019-11-28T08:56:59ZGradl, TobiasRefactor index mapping generation / conversion- analyzers
- data types
*(from redmine: issue id 623, created on 2018-01-22tgradl, closed on 2018-01-24)*- analyzers
- data types
*(from redmine: issue id 623, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/186Move to a dedicated GS configuration schema for resources2019-11-28T08:56:58ZGradl, TobiasMove to a dedicated GS configuration schema for resourcesThere is no need or real benefit from converting indexed resources at
query time; instead, extract title, link etc. at indexing time and index
with resource
*(from redmine: issue id 622, created on 2018-01-22tgradl, closed on 2018-01-2...There is no need or real benefit from converting indexed resources at
query time; instead, extract title, link etc. at indexing time and index
with resource
*(from redmine: issue id 622, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #6133.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/184Translate _any field query2019-11-28T08:56:55ZGradl, TobiasTranslate _any field queryequal in other schemas
*(from redmine: issue id 620, created on 2018-01-22tgradl, closed on 2018-01-24)*equal in other schemas
*(from redmine: issue id 620, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/183Prevent session id from being exposed as get parameter2019-11-28T08:56:54ZGradl, TobiasPrevent session id from being exposed as get parameter- update web.xml to java 7 ->3.1 schema
*(from redmine: issue id 619, created on 2018-01-22tgradl, closed on 2018-01-24)*- update web.xml to java 7 ->3.1 schema
*(from redmine: issue id 619, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/182Migrate collection selection2019-11-28T08:56:53ZGradl, TobiasMigrate collection selectionas pre-stage to ownSearch
*(from redmine: issue id 618, created on 2018-01-22tgradl, closed on 2018-01-24)*as pre-stage to ownSearch
*(from redmine: issue id 618, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/181Adapt to CLARIN use case2019-11-28T08:56:52ZGradl, TobiasAdapt to CLARIN use case- Redeclaration of namespaces
*(from redmine: issue id 617, created on 2018-01-22tgradl, closed on 2018-01-24)*- Redeclaration of namespaces
*(from redmine: issue id 617, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/178Implement manual selection of oaipmh prefix for endpoints/schema assignments2019-11-28T08:56:48ZGradl, TobiasImplement manual selection of oaipmh prefix for endpoints/schema assignmentse.g. cmdi can often not automatically be detected
*(from redmine: issue id 614, created on 2018-01-22tgradl, closed on 2018-01-24)*e.g. cmdi can often not automatically be detected
*(from redmine: issue id 614, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/175Encapsulate elasticsearch access in a new 'esx' layer2019-11-28T08:56:44ZGradl, TobiasEncapsulate elasticsearch access in a new 'esx' layer- Client like mongotemplate only used from within esx classes
*(from redmine: issue id 611, created on 2018-01-22tgradl, closed on 2018-01-24)*- Client like mongotemplate only used from within esx classes
*(from redmine: issue id 611, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/174Adjust mapping creation to new string mappings2019-11-28T08:56:43ZGradl, TobiasAdjust mapping creation to new string mappingsShould we be less dependent on this? Other option: put, then get right
away and persist this get for further comparison
*(from redmine: issue id 610, created on 2018-01-22tgradl, closed on 2018-01-24)*Should we be less dependent on this? Other option: put, then get right
away and persist this get for further comparison
*(from redmine: issue id 610, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/173Rethink content keys as ES > 5.0 will not allow empty keys2019-11-28T08:56:42ZGradl, TobiasRethink content keys as ES > 5.0 will not allow empty keysback to <sub>?\ yes\ why\ not,\ and\ only</sub>
*(from redmine: issue id 609, created on 2018-01-22tgradl, closed on 2018-01-24)*back to <sub>?\ yes\ why\ not,\ and\ only</sub>
*(from redmine: issue id 609, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/172Upgrade to ES 5.02019-11-28T08:56:41ZGradl, TobiasUpgrade to ES 5.0- Upgrade to Java 8 required
- Only minor changes in code for compilation errors
- log4j 2 requires binding to slf4j
- new string mappings ->task 610
*(from redmine: issue id 608, created on 2018-01-22tgradl, closed on 2018-01-...- Upgrade to Java 8 required
- Only minor changes in code for compilation errors
- log4j 2 requires binding to slf4j
- new string mappings ->task 610
*(from redmine: issue id 608, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobias