{"id":"ops/search-graph-provisioning","relativePath":"ops/search-graph-provisioning.md","title":"Solr 9 + GraphDB Provisioning","markdown":"# Solr 9 + GraphDB Provisioning\n\nThis runbook provisions the Era C1 search/graph stack:\n\n- Solr 9 (LUX-aligned search/faceting path)\n- GraphDB CE (Ontotext OSS path)\n\nFor local trace export wiring (Tempo / Jaeger), see `docs/ops/otel-local.md`.\n\n## Dev runtime (Docker Compose)\n\nCompose stack file: `ops/docker-compose.yml`\n\n- Postgres stays in the default profile (`pnpm db:up`).\n- Solr + GraphDB are in the `sota` profile (`pnpm infra:sota:up`).\n\nCommands:\n\n```bash\npnpm infra:sota:up\npnpm infra:sota:down\n```\n\nExposed ports:\n\n- Solr: `http://localhost:8983/solr`\n- GraphDB: `http://localhost:7200`\n\nImages:\n\n- `solr:9.6`\n- `ontotext/graphdb:10.8.14` (GraphDB CE path via license-less default runtime)\n\n## Kubernetes runtime (Helm)\n\nChart path:\n\n- `ops/helm/metamuseum-search-graph`\n\nRender manifests:\n\n```bash\npnpm infra:sota:helm:template\n```\n\nInstall:\n\n```bash\nhelm upgrade --install metamuseum-search-graph ops/helm/metamuseum-search-graph --namespace metamuseum --create-namespace\n```\n\nPort-forward for local validation:\n\n```bash\nkubectl -n metamuseum port-forward svc/metamuseum-search-graph-solr 8983:8983\nkubectl -n metamuseum port-forward svc/metamuseum-search-graph-graphdb 7200:7200\n```\n\n## Persistence defaults\n\nDefault PVC requests in `values.yaml`:\n\n- Solr: `20Gi`\n- GraphDB: `50Gi`\n\nOverride storage class and size with Helm `--set` or a values override file.\n\n## GraphDB repository + SPARQL + Lucene bootstrap\n\nAfter GraphDB is running, initialize the repository and Lucene connector:\n\n```bash\npnpm graphdb:bootstrap\n```\n\nThis script:\n\n- creates repository `metamuseum` when missing (GraphDB REST `POST /rest/repositories` with `.ttl` config),\n- enforces the runtime reasoning policy (`GRAPHDB_RULESET` must be `rdfsplus` or `rdfsplus-optimized`; OWL-family rulesets are rejected),\n- confirms SPARQL 1.1 query/update endpoints:\n - query: `/repositories/metamuseum`\n - update/Graph Store: `/repositories/metamuseum/statements`\n- creates Lucene connector `metamuseum_index` if missing via `luc:createConnector`,\n- configures a `graph()`-indexed field for hybrid text + graph filtering by named graph.\n\nReasoning profile policy:\n\n- Runtime inference: `RDFS` (`rdfsplus` or `rdfsplus-optimized`).\n- Constraint validation: `SHACL` via the validation service (`/api/validate`).\n- Disallowed at runtime: full OWL-family reasoning profiles.\n\n## Named-graph provenance partitioning by source institution\n\nLoad provider RDF payloads into source-specific named graphs:\n\n```bash\npnpm graphdb:load:named-graph -- --provider=met --file=./artifacts/records-met.nq\npnpm graphdb:load:named-graph -- --provider=getty --file=./artifacts/records-getty.nq\n```\n\nBy default, loads run in replace mode per named graph.\nUse `--append` to append instead of replace.\n\nNamed graph pattern:\n\n- `https://lod.metamuseum.org/graph/source/{institution-slug}`\n\nExamples:\n\n- Met: `https://lod.metamuseum.org/graph/source/metropolitan-museum-of-art`\n- Getty: `https://lod.metamuseum.org/graph/source/j-paul-getty-museum`\n\n## Hybrid text + graph query example (Lucene + named graph)\n\nAfter bootstrap and data load, a query pattern can combine full-text retrieval with\ngraph partition filtering:\n\n```sparql\nPREFIX luc: \nPREFIX luc-index: \n\nSELECT ?entity ?score WHERE {\n ?search a luc-index:metamuseum_index ;\n luc:query \"label:portrait AND labelGraph:https\\\\://lod.metamuseum.org/graph/source/metropolitan-museum-of-art\" ;\n luc:entities ?entity .\n ?entity luc:score ?score .\n}\n```\n\nThe Lucene connector behavior and `graph()` chain semantics used here follow\nGraphDB Lucene Connector documentation.\n","sections":[{"level":2,"heading":"Dev runtime (Docker Compose)","anchor":"dev-runtime-docker-compose"},{"level":2,"heading":"Kubernetes runtime (Helm)","anchor":"kubernetes-runtime-helm"},{"level":2,"heading":"Persistence defaults","anchor":"persistence-defaults"},{"level":2,"heading":"GraphDB repository + SPARQL + Lucene bootstrap","anchor":"graphdb-repository-sparql-lucene-bootstrap"},{"level":2,"heading":"Named-graph provenance partitioning by source institution","anchor":"named-graph-provenance-partitioning-by-source-institution"},{"level":2,"heading":"Hybrid text + graph query example (Lucene + named graph)","anchor":"hybrid-text-graph-query-example-lucene-named-graph"}],"html":"

Solr 9 + GraphDB Provisioning

\n

This runbook provisions the Era C1 search/graph stack:

\n\n

For local trace export wiring (Tempo / Jaeger), see `docs/ops/otel-local.md`.

\n

Dev runtime (Docker Compose)

\n

Compose stack file: `ops/docker-compose.yml`

\n\n

Commands:

\n
\npnpm infra:sota:up\npnpm infra:sota:down\n
\n

Exposed ports:

\n\n

Images:

\n\n

Kubernetes runtime (Helm)

\n

Chart path:

\n\n

Render manifests:

\n
\npnpm infra:sota:helm:template\n
\n

Install:

\n
\nhelm upgrade --install metamuseum-search-graph ops/helm/metamuseum-search-graph --namespace metamuseum --create-namespace\n
\n

Port-forward for local validation:

\n
\nkubectl -n metamuseum port-forward svc/metamuseum-search-graph-solr 8983:8983\nkubectl -n metamuseum port-forward svc/metamuseum-search-graph-graphdb 7200:7200\n
\n

Persistence defaults

\n

Default PVC requests in `values.yaml`:

\n\n

Override storage class and size with Helm `--set` or a values override file.

\n

GraphDB repository + SPARQL + Lucene bootstrap

\n

After GraphDB is running, initialize the repository and Lucene connector:

\n
\npnpm graphdb:bootstrap\n
\n

This script:

\n\n

Reasoning profile policy:

\n\n

Named-graph provenance partitioning by source institution

\n

Load provider RDF payloads into source-specific named graphs:

\n
\npnpm graphdb:load:named-graph -- --provider=met --file=./artifacts/records-met.nq\npnpm graphdb:load:named-graph -- --provider=getty --file=./artifacts/records-getty.nq\n
\n

By default, loads run in replace mode per named graph.

\n

Use `--append` to append instead of replace.

\n

Named graph pattern:

\n\n

Examples:

\n\n

Hybrid text + graph query example (Lucene + named graph)

\n

After bootstrap and data load, a query pattern can combine full-text retrieval with

\n

graph partition filtering:

\n
\nPREFIX luc: <http://www.ontotext.com/connectors/lucene#>\nPREFIX luc-index: <http://www.ontotext.com/connectors/lucene/instance#>\n\nSELECT ?entity ?score WHERE {\n  ?search a luc-index:metamuseum_index ;\n          luc:query "label:portrait AND labelGraph:https\\\\://lod.metamuseum.org/graph/source/metropolitan-museum-of-art" ;\n          luc:entities ?entity .\n  ?entity luc:score ?score .\n}\n
\n

The Lucene connector behavior and `graph()` chain semantics used here follow

\n

GraphDB Lucene Connector documentation.

","updatedAt":"2018-10-20T01:46:40.000Z","checksum":"fc1b15279a8466c09fe033823683886526268407f6ce8961088b53a3cc4e75f7","checksumPrefix":"fc1b15279a84","anchorCount":6,"lineCount":132,"rawUrl":"/api/docs/content?path=ops%2Fsearch-graph-provisioning.md","htmlUrl":"/docs?doc=ops%2Fsearch-graph-provisioning.md","apiUrl":"/api/docs/content?path=ops%2Fsearch-graph-provisioning.md"}