dariah issueshttps://gitlab.rz.uni-bamberg.de/groups/dariah/-/issues2019-11-28T08:56:52Zhttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/181Adapt to CLARIN use case2019-11-28T08:56:52ZGradl, TobiasAdapt to CLARIN use case- Redeclaration of namespaces
*(from redmine: issue id 617, created on 2018-01-22tgradl, closed on 2018-01-24)*- Redeclaration of namespaces
*(from redmine: issue id 617, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/178Implement manual selection of oaipmh prefix for endpoints/schema assignments2019-11-28T08:56:48ZGradl, TobiasImplement manual selection of oaipmh prefix for endpoints/schema assignmentse.g. cmdi can often not automatically be detected
*(from redmine: issue id 614, created on 2018-01-22tgradl, closed on 2018-01-24)*e.g. cmdi can often not automatically be detected
*(from redmine: issue id 614, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/176Rethink and implement automations2019-11-28T08:56:46ZGradl, TobiasRethink and implement automations<p>
\* Actions in consequence of sync processes \* "Clean and rebuild
index&quot; action ->detect relevant enpoints, latest crawls etc.
</p>
*(from redmine: issue id 612, created on 2018-01-22tgradl, closed on 2018-02-09)*
* Relatio...<p>
\* Actions in consequence of sync processes \* "Clean and rebuild
index" action ->detect relevant enpoints, latest crawls etc.
</p>
*(from redmine: issue id 612, created on 2018-01-22tgradl, closed on 2018-02-09)*
* Relations:
* duplicates #8963.3Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/175Encapsulate elasticsearch access in a new 'esx' layer2019-11-28T08:56:44ZGradl, TobiasEncapsulate elasticsearch access in a new 'esx' layer- Client like mongotemplate only used from within esx classes
*(from redmine: issue id 611, created on 2018-01-22tgradl, closed on 2018-01-24)*- Client like mongotemplate only used from within esx classes
*(from redmine: issue id 611, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/174Adjust mapping creation to new string mappings2019-11-28T08:56:43ZGradl, TobiasAdjust mapping creation to new string mappingsShould we be less dependent on this? Other option: put, then get right
away and persist this get for further comparison
*(from redmine: issue id 610, created on 2018-01-22tgradl, closed on 2018-01-24)*Should we be less dependent on this? Other option: put, then get right
away and persist this get for further comparison
*(from redmine: issue id 610, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/173Rethink content keys as ES > 5.0 will not allow empty keys2019-11-28T08:56:42ZGradl, TobiasRethink content keys as ES > 5.0 will not allow empty keysback to <sub>?\ yes\ why\ not,\ and\ only</sub>
*(from redmine: issue id 609, created on 2018-01-22tgradl, closed on 2018-01-24)*back to <sub>?\ yes\ why\ not,\ and\ only</sub>
*(from redmine: issue id 609, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/172Upgrade to ES 5.02019-11-28T08:56:41ZGradl, TobiasUpgrade to ES 5.0- Upgrade to Java 8 required
- Only minor changes in code for compilation errors
- log4j 2 requires binding to slf4j
- new string mappings ->task 610
*(from redmine: issue id 608, created on 2018-01-22tgradl, closed on 2018-01-...- Upgrade to Java 8 required
- Only minor changes in code for compilation errors
- log4j 2 requires binding to slf4j
- new string mappings ->task 610
*(from redmine: issue id 608, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/171Bug: Concurrency problem when indexing2019-11-28T08:56:40ZGradl, TobiasBug: Concurrency problem when indexingindexer as prototype?!
*(from redmine: issue id 607, created on 2018-01-22tgradl, closed on 2018-08-17)*indexer as prototype?!
*(from redmine: issue id 607, created on 2018-01-22tgradl, closed on 2018-08-17)*3.4Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/170Consequently implement managers as design pattern when using threading2019-11-28T08:56:39ZGradl, TobiasConsequently implement managers as design pattern when using threading- sync
- indexing
- crawling
*(from redmine: issue id 606, created on 2018-01-22tgradl, closed on 2018-01-24)*- sync
- indexing
- crawling
*(from redmine: issue id 606, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/168Refactor ColReg sync2019-11-28T08:56:36ZGradl, TobiasRefactor ColReg syncthink of required actions also to the index
*(from redmine: issue id 604, created on 2018-01-22tgradl, closed on 2018-01-24)*think of required actions also to the index
*(from redmine: issue id 604, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/167Rethink necessity to save grammars, schema definition etc. in file system2019-11-28T08:56:35ZGradl, TobiasRethink necessity to save grammars, schema definition etc. in file systemgrammars might be ok to preserve independence, we could however override
standard gtf behavior
*(from redmine: issue id 603, created on 2018-01-22tgradl, closed on 2018-08-17)*grammars might be ok to preserve independence, we could however override
standard gtf behavior
*(from redmine: issue id 603, created on 2018-01-22tgradl, closed on 2018-08-17)*3.4Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/166Refactor ScheReg schema sync2019-11-28T08:56:34ZGradl, TobiasRefactor ScheReg schema synccheck what needs to be done in what circumstances ->mongo, index,
filesystem
*(from redmine: issue id 602, created on 2018-01-22tgradl, closed on 2018-01-24)*check what needs to be done in what circumstances ->mongo, index,
filesystem
*(from redmine: issue id 602, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/165Refactor / implement mapping sync2019-11-28T08:56:33ZGradl, TobiasRefactor / implement mapping sync- performance and independence improvement
- sync often ~ every some minutes
- manual sync through interface possible
*(from redmine: issue id 601, created on 2018-01-22tgradl, closed on 2018-01-24)*- performance and independence improvement
- sync often ~ every some minutes
- manual sync through interface possible
*(from redmine: issue id 601, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/162Implement CustomSearch as successor of user collections2019-11-28T08:56:30ZGradl, TobiasImplement CustomSearch as successor of user collections- collection selection ->user collections (old concept)
- new: schema selection (select transformation targets)
*(from redmine: issue id 598, created on 2018-01-22tgradl, closed on 2018-02-13)*- collection selection ->user collections (old concept)
- new: schema selection (select transformation targets)
*(from redmine: issue id 598, created on 2018-01-22tgradl, closed on 2018-02-13)*3.3Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/159Separate crawling from processing/indexing2019-11-28T08:56:27ZGradl, TobiasSeparate crawling from processing/indexing- no more OAI PMH processing service
- fetch files depending on interface
- then iterate files
*(from redmine: issue id 594, created on 2018-01-22tgradl, closed on 2018-01-24)*- no more OAI PMH processing service
- fetch files depending on interface
- then iterate files
*(from redmine: issue id 594, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/158Make metadata prefix configurable2019-11-28T08:56:26ZGradl, TobiasMake metadata prefix configurablesave with endpoint schema asignment
*(from redmine: issue id 593, created on 2018-01-22tgradl, closed on 2018-01-24)*save with endpoint schema asignment
*(from redmine: issue id 593, created on 2018-01-22tgradl, closed on 2018-01-24)*3.0Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/157Prevent setup errors with empty databases2019-11-28T08:56:24ZGradl, TobiasPrevent setup errors with empty databasesmongo and es
*(from redmine: issue id 592, created on 2018-01-22tgradl, closed on 2018-01-24)*mongo and es
*(from redmine: issue id 592, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/156Remove MWW branding and create fork for such adaptions2019-11-28T08:56:23ZGradl, TobiasRemove MWW branding and create fork for such adaptionsfork?
*(from redmine: issue id 591, created on 2018-01-22tgradl, closed on 2018-01-24)*fork?
*(from redmine: issue id 591, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/155Implement rudimentary security2019-11-28T08:56:22ZGradl, TobiasImplement rudimentary securitylocal accounts
*(from redmine: issue id 590, created on 2018-01-22tgradl, closed on 2018-01-24)*local accounts
*(from redmine: issue id 590, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobiashttps://gitlab.rz.uni-bamberg.de/dariah/search/-/issues/154Show document count in datasource viewer2019-11-28T08:56:21ZGradl, TobiasShow document count in datasource viewerper endpoint/mapping
*(from redmine: issue id 589, created on 2018-01-22tgradl, closed on 2018-01-24)*per endpoint/mapping
*(from redmine: issue id 589, created on 2018-01-22tgradl, closed on 2018-01-24)*3.2Gradl, TobiasGradl, Tobias