search issueshttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues2019-11-28T08:56:39Zhttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/170Consequently implement managers as design pattern when using threading2019-11-28T08:56:39ZGradl, TobiasConsequently implement managers as design pattern when using threading- sync
- indexing
- crawling
*(from redmine: issue id 606, created on 2018-01-22tgradl, closed on 2018-01-24)*- sync
- indexing
- crawling
*(from redmine: issue id 606, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/168Refactor ColReg sync2019-11-28T08:56:36ZGradl, TobiasRefactor ColReg syncthink of required actions also to the index
*(from redmine: issue id 604, created on 2018-01-22tgradl, closed on 2018-01-24)*think of required actions also to the index
*(from redmine: issue id 604, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/166Refactor ScheReg schema sync2019-11-28T08:56:34ZGradl, TobiasRefactor ScheReg schema synccheck what needs to be done in what circumstances ->mongo, index,
filesystem
*(from redmine: issue id 602, created on 2018-01-22tgradl, closed on 2018-01-24)*check what needs to be done in what circumstances ->mongo, index,
filesystem
*(from redmine: issue id 602, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/165Refactor / implement mapping sync2019-11-28T08:56:33ZGradl, TobiasRefactor / implement mapping sync- performance and independence improvement
- sync often ~ every some minutes
- manual sync through interface possible
*(from redmine: issue id 601, created on 2018-01-22tgradl, closed on 2018-01-24)*- performance and independence improvement
- sync often ~ every some minutes
- manual sync through interface possible
*(from redmine: issue id 601, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/159Separate crawling from processing/indexing2019-11-28T08:56:27ZGradl, TobiasSeparate crawling from processing/indexing- no more OAI PMH processing service
- fetch files depending on interface
- then iterate files
*(from redmine: issue id 594, created on 2018-01-22tgradl, closed on 2018-01-24)*- no more OAI PMH processing service
- fetch files depending on interface
- then iterate files
*(from redmine: issue id 594, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/157Prevent setup errors with empty databases2019-11-28T08:56:24ZGradl, TobiasPrevent setup errors with empty databasesmongo and es
*(from redmine: issue id 592, created on 2018-01-22tgradl, closed on 2018-01-24)*mongo and es
*(from redmine: issue id 592, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/156Remove MWW branding and create fork for such adaptions2019-11-28T08:56:23ZGradl, TobiasRemove MWW branding and create fork for such adaptionsfork?
*(from redmine: issue id 591, created on 2018-01-22tgradl, closed on 2018-01-24)*fork?
*(from redmine: issue id 591, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/155Implement rudimentary security2019-11-28T08:56:22ZGradl, TobiasImplement rudimentary securitylocal accounts
*(from redmine: issue id 590, created on 2018-01-22tgradl, closed on 2018-01-24)*local accounts
*(from redmine: issue id 590, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/154Show document count in datasource viewer2019-11-28T08:56:21ZGradl, TobiasShow document count in datasource viewerper endpoint/mapping
*(from redmine: issue id 589, created on 2018-01-22tgradl, closed on 2018-01-24)*per endpoint/mapping
*(from redmine: issue id 589, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/153Implement file adapter in generic search2019-11-28T08:56:20ZGradl, TobiasImplement file adapter in generic search.
*(from redmine: issue id 588, created on 2018-01-22tgradl, closed on 2018-01-24)*.
*(from redmine: issue id 588, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/151Wordcloud does not load on browser start2019-11-28T08:56:18ZGradl, TobiasWordcloud does not load on browser startThis issue is based on jsessionid being appended in baseUrl ->use
util.composeUrl instead
*(from redmine: issue id 586, created on 2018-01-22tgradl, closed on 2018-01-24)*This issue is based on jsessionid being appended in baseUrl ->use
util.composeUrl instead
*(from redmine: issue id 586, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/145Implement home for MWW search2019-11-28T08:56:11ZGradl, TobiasImplement home for MWW search- search box
- wordcloud
- MWW colors and logos
*(from redmine: issue id 580, created on 2018-01-22tgradl, closed on 2018-01-24)*- search box
- wordcloud
- MWW colors and logos
*(from redmine: issue id 580, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/144Implement aggregations for wordcloud2019-11-28T08:56:10ZGradl, TobiasImplement aggregations for wordcloud- Home page on every index
- With collection results on regular search
*(from redmine: issue id 579, created on 2018-01-22tgradl, closed on 2018-01-24)*- Home page on every index
- With collection results on regular search
*(from redmine: issue id 579, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/143Setup analyzers as configured with indices and utilize2019-11-28T08:56:08ZGradl, TobiasSetup analyzers as configured with indices and utilize- Analyzers should be defined in generic search and have a good common
name
- Analyzers are then referenced in the schema definition of the
gs-index-model
- Individual analyzers are utilized once mapped by a source schema
-...- Analyzers should be defined in generic search and have a good common
name
- Analyzers are then referenced in the schema definition of the
gs-index-model
- Individual analyzers are utilized once mapped by a source schema
- No special treatment needs to be applied when processing and
indexing documents
*(from redmine: issue id 578, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/142Implement metadata prefix correlation for XML root namespaces2019-11-28T08:56:07ZGradl, TobiasImplement metadata prefix correlation for XML root namespaces- Serves to detect correct local prefix to use when crawling data
- Schemata do not have to be named after local OAI-PMH prefixes
*(from redmine: issue id 577, created on 2018-01-22tgradl, closed on 2018-01-24)*- Serves to detect correct local prefix to use when crawling data
- Schemata do not have to be named after local OAI-PMH prefixes
*(from redmine: issue id 577, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/141Upgrade to new metamodel components and processing2019-11-28T08:56:06ZGradl, TobiasUpgrade to new metamodel components and processing- metamodel
- processing
- gtf?
*(from redmine: issue id 576, created on 2018-01-22tgradl, closed on 2018-01-24)*- metamodel
- processing
- gtf?
*(from redmine: issue id 576, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/139Configure indexing with dedicated schema/mappings2019-11-28T08:56:04ZGradl, TobiasConfigure indexing with dedicated schema/mappings- data types
- analyzers
etc.
*(from redmine: issue id 531, created on 2018-01-22tgradl, closed on 2018-01-24)*- data types
- analyzers
etc.
*(from redmine: issue id 531, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/138Refactor OAI-PMH online/offline crawling, XML crawling2019-11-28T08:56:03ZGradl, TobiasRefactor OAI-PMH online/offline crawling, XML crawlingRedundant code etc.
*(from redmine: issue id 530, created on 2018-01-22tgradl, closed on 2018-01-24)*Redundant code etc.
*(from redmine: issue id 530, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/137Grammars in mappings not executed2019-11-28T08:56:01ZGradl, TobiasGrammars in mappings not executedProblem: Grammars and functions expect labels as targets…is this
restriction really important?
*(from redmine: issue id 529, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #527Problem: Grammars and functions expect labels as targets…is this
restriction really important?
*(from redmine: issue id 529, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #5273.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/136Consume grammars and functions with schema and mapping APIs and persist2019-11-28T08:56:00ZGradl, TobiasConsume grammars and functions with schema and mapping APIs and persist- Detection of freshness
*(from redmine: issue id 527, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #529- Detection of freshness
*(from redmine: issue id 527, created on 2018-01-22tgradl, closed on 2018-01-24)*
* Relations:
* relates #5293.2Gradl, TobiasGradl, Tobias