dariah issueshttps://gitlab.rz.uni-bamberg.de/groups/dariah/-/issues2019-11-28T08:57:35Zhttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/218Investigate crawling memory leak2019-11-28T08:57:35ZGradl, TobiasInvestigate crawling memory leakprofile Java?
*(from redmine: issue id 802, created on 2018-01-22tgradl, closed on 2018-01-24)*profile Java?
*(from redmine: issue id 802, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/217Fix parallel threads for crawling2019-11-28T08:57:33ZGradl, TobiasFix parallel threads for crawling- seems to fail in Cosmotool currently
- every processing step set to prototype now =>possibly bad for
API based Dispatching (queuing with synchronization?)
*(from redmine: issue id 801, created on 2018-01-22tgradl, closed on 2...- seems to fail in Cosmotool currently
- every processing step set to prototype now =>possibly bad for
API based Dispatching (queuing with synchronization?)
*(from redmine: issue id 801, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #8043.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/216Upgrade underlying frameworks2019-11-28T08:57:32ZGradl, TobiasUpgrade underlying frameworksbase like Cosmotool
*(from redmine: issue id 800, created on 2018-01-22tgradl, closed on 2018-01-24)*base like Cosmotool
*(from redmine: issue id 800, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/214Implement configured-by-mapping imagelinks2019-11-28T08:57:30ZGradl, TobiasImplement configured-by-mapping imagelinksIndexing ->Image
*(from redmine: issue id 680, created on 2018-01-22tgradl, closed on 2018-01-24)*Indexing ->Image
*(from redmine: issue id 680, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/213Implement configured-by-mapping identifiers2019-11-28T08:57:28ZGradl, TobiasImplement configured-by-mapping identifiersIndexing ->Identifier
*(from redmine: issue id 679, created on 2018-01-22tgradl, closed on 2018-01-24)*Indexing ->Identifier
*(from redmine: issue id 679, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/212Implement search result preview2019-11-28T08:57:27ZGradl, TobiasImplement search result preview- mainly implemented for pictures in WissKI
- reusable for links (screenshots)
*(from redmine: issue id 678, created on 2018-01-22tgradl, closed on 2018-01-24)*- mainly implemented for pictures in WissKI
- reusable for links (screenshots)
*(from redmine: issue id 678, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/210Extract common functionality into search-commons library2019-11-28T08:57:25ZGradl, TobiasExtract common functionality into search-commons libraryreusable for Cosmotool and potentially other searches
*(from redmine: issue id 655, created on 2018-01-22tgradl, closed on 2018-01-24)*reusable for Cosmotool and potentially other searches
*(from redmine: issue id 655, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/205Implement online file adapter2019-11-28T08:57:19ZGradl, TobiasImplement online file adapter- dowload
- unpack / untar
- chunk
*(from redmine: issue id 643, created on 2018-01-22tgradl, closed on 2018-02-09)*- dowload
- unpack / untar
- chunk
*(from redmine: issue id 643, created on 2018-01-22tgradl, closed on 2018-02-09)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/203OaiPmhHarvester should know about record state2019-11-28T08:57:17ZGradl, TobiasOaiPmhHarvester should know about record stateTo provide size and progress
*(from redmine: issue id 641, created on 2018-01-22tgradl, closed on 2018-01-24)*To provide size and progress
*(from redmine: issue id 641, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/202Complete transparency for crawls2019-11-28T08:57:15ZGradl, TobiasComplete transparency for crawls- Crawl manager handles inquiries to threads
*(from redmine: issue id 640, created on 2018-01-22tgradl, closed on 2018-01-24)*- Crawl manager handles inquiries to threads
*(from redmine: issue id 640, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/201Have OaiPmhHarvestingService fail if response is not ListRecords2019-11-28T08:57:14ZGradl, TobiasHave OaiPmhHarvestingService fail if response is not ListRecordstypically if no good metadata prefix is used or url wrong etc.
*(from redmine: issue id 639, created on 2018-01-22tgradl, closed on 2018-01-24)*typically if no good metadata prefix is used or url wrong etc.
*(from redmine: issue id 639, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/200Implement prefix autodetection in OaiPmhCrawler / OaiPmhHarvestingService2019-11-28T08:57:13ZGradl, TobiasImplement prefix autodetection in OaiPmhCrawler / OaiPmhHarvestingServiceTry much in OaiPmhHarvestingService, only crawl related aspects
(persistence) in OaiPmhCrawler
*(from redmine: issue id 638, created on 2018-01-22tgradl, closed on 2018-01-24)*Try much in OaiPmhHarvestingService, only crawl related aspects
(persistence) in OaiPmhCrawler
*(from redmine: issue id 638, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/193Consolidate datasource info and actions under comprehensive new view2019-11-28T08:57:06ZGradl, TobiasConsolidate datasource info and actions under comprehensive new view- Crawls
- Schema info
- …
*(from redmine: issue id 631, created on 2018-01-22tgradl, closed on 2018-01-24)*- Crawls
- Schema info
- …
*(from redmine: issue id 631, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/189Implement data type handling (complete example: geo_points)2019-11-28T08:57:01ZGradl, TobiasImplement data type handling (complete example: geo_points)follow up in task 627
*(from redmine: issue id 627, created on 2018-01-22tgradl, closed on 2018-01-24)*follow up in task 627
*(from redmine: issue id 627, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/188Outdate schema definitions2019-11-28T08:57:00ZGradl, TobiasOutdate schema definitions- when changed in SR
- when mapping to GS Model changes as well!
- Not automations right now
*(from redmine: issue id 624, created on 2018-01-22tgradl, closed on 2018-01-24)*- when changed in SR
- when mapping to GS Model changes as well!
- Not automations right now
*(from redmine: issue id 624, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/187Refactor index mapping generation / conversion2019-11-28T08:56:59ZGradl, TobiasRefactor index mapping generation / conversion- analyzers
- data types
*(from redmine: issue id 623, created on 2018-01-22tgradl, closed on 2018-01-24)*- analyzers
- data types
*(from redmine: issue id 623, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/186Move to a dedicated GS configuration schema for resources2019-11-28T08:56:58ZGradl, TobiasMove to a dedicated GS configuration schema for resourcesThere is no need or real benefit from converting indexed resources at
query time; instead, extract title, link etc. at indexing time and index
with resource
*(from redmine: issue id 622, created on 2018-01-22tgradl, closed on 2018-01-2...There is no need or real benefit from converting indexed resources at
query time; instead, extract title, link etc. at indexing time and index
with resource
*(from redmine: issue id 622, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #6133.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/184Translate _any field query2019-11-28T08:56:55ZGradl, TobiasTranslate _any field queryequal in other schemas
*(from redmine: issue id 620, created on 2018-01-22tgradl, closed on 2018-01-24)*equal in other schemas
*(from redmine: issue id 620, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/183Prevent session id from being exposed as get parameter2019-11-28T08:56:54ZGradl, TobiasPrevent session id from being exposed as get parameter- update web.xml to java 7 ->3.1 schema
*(from redmine: issue id 619, created on 2018-01-22tgradl, closed on 2018-01-24)*- update web.xml to java 7 ->3.1 schema
*(from redmine: issue id 619, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/182Migrate collection selection2019-11-28T08:56:53ZGradl, TobiasMigrate collection selectionas pre-stage to ownSearch
*(from redmine: issue id 618, created on 2018-01-22tgradl, closed on 2018-01-24)*as pre-stage to ownSearch
*(from redmine: issue id 618, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobias