Strata: multilingual media intelligence and rights data

1. Summary

Strata is a self-hosted service that puts what a broadcast programme contains on one timeline: what was said and by whom, in which language, what was on screen, what other systems reported about it, and the music rights data behind it. It is one program with an HTTP API of 75 operations, described in OpenAPI 3.1, and a console for people. Every model it uses has published weights and runs on the server: on Webinson's servers in Nuremberg, Germany, or in a partner's own environment.

Strata is developed by Webinson s.r.o., a software company in Košice, Slovakia, with 15 years of software engineering behind it. Since spring 2023 Webinson has built and run Vocabulift, a language-learning product that works with speech in real video; Strata grows out of that work for media, monitoring and rights.

2. What Strata does today

Recorded demo output

The following excerpt comes from our existing 44-second synthetic Greek and English test clip. It is a technical example of event correlation, independent of the languages of a partner's programmes. An audio identification event connects to the catalogue and the bulletin's cue sheet. Trimmed:

{
  "event": {
    "kind": "content_match", "source": "fingerprinting",
    "start_ms": 33875, "end_ms": 43937,
    "data": { "confidence": 0.97, "recording": {
      "title": "To fos tis polis", "artists": ["Anna Demeti"],
      "isrc": "GRX9D2600001" } }
  },
  "speech": [
    { "text": "Καλή σας νύχτα.", "start_ms": 32170, "end_ms": 33330, "gap_ms": 545 }
  ],
  "on_screen_text": [
    { "text": "ΜΟΥΣΙΚΗ", "start_ms": 33875, "end_ms": 43937, "overlap_ms": 10062 },
    { "text": "Το φως της πόλης Άννα Δεμέτη", "start_ms": 33875, "end_ms": 43937, "overlap_ms": 10062 }
  ],
  "shots": [4]
}

3. API and integration

• 75 operations in ten areas, described in OpenAPI 3.1, with an interactive reference at vocabulift.com/docs and a functional guide with workflows and real examples.
• Keys with scopes for media, rights data, cue sheets and administration. Errors are RFC 9457 problem details whose pointers name the field; lists page with cursors.
• Background work accepts an Idempotency-Key, so retries never start it twice; job progress streams as server-sent events.
• Webhooks when media is ready, a job ends, a link is proposed, a conflict opens or a cue sheet moves on, signed as the Standard Webhooks specification describes (HMAC-SHA256) and retried until delivered.
• What the picture shows as one list (/detections): shots, scenes, on-screen text, logos, objects, people and actions, each with an HH:MM:SS.mmm timestamp, a type, a label and a confidence, ready to join with an identification system's results.
• Results as JSON, layer by layer or as one merged timeline; transcripts and subtitles as VTT, SRT and text; CSV and JSON exports; cue sheets as CSV, JSON, Excel and XML.

4. Performance

We do not quote general accuracy figures; they say little about your programmes. In the pilot we report, on your material and against your references:

• word and character error rate by language, channel and programme type;
• word-timing deviation from reference timestamps, and speaker attribution;
• on-screen text accuracy, and the precision and recall of recording-to-work matching;
• processing speed (real-time factor) and cost per hour for each deployment option;
• the share of results below an agreed confidence threshold, for human review.

For orientation: the 44-second sample goes through all eleven stages in about 20 seconds on a laptop with Apple silicon, and in about two minutes on the shared, CPU-only server of the public instance. On the same laptop, the vision model reads three and a half minutes of a launch broadcast (shots, text, logos, objects, people and actions) in about two and a half minutes. A GPU makes speech recognition and the vision model many times faster; hardware for your volumes is sized in the pilot.

5. Computing and deployment

Strata is one program, written in Rust, with one SQLite database file and model files pinned by their SHA-256 checksums. It runs on Linux, on CPU or with a GPU.

• Hosted in the EU. The public instance runs on Webinson's servers in Nuremberg, Germany, declared with NixOS: models are fetched by their checksums, loaded while analyses need them and released when idle, the language model starts on demand, and the database is copied every night.
• Private deployment. The same program inside your environment or a European data centre you choose. No media is sent to an outside AI service, and every model can be replaced, the language model by a larger one.

6. Cooperation, licensing and IP

Commercial agreement with technical assistance

A licence to Strata, run by Webinson or in your environment, with Webinson's documentation, interfaces and support for integration, configuration, testing and validation. Licence terms, deployment requirements, performance parameters and any restrictions on use or data processing are set out before integration.

Research and development cooperation agreement

Joint development where your material and needs go beyond what Strata does today: tuning for your languages and channels, boxes around what is seen and fast detectors trained on your own footage for the logos and products that matter to you, the same speaker recognised across programmes, and your partners' exchange formats such as CWR and DDEX, validated in defined pilot applications on your platform.

Each party keeps ownership of its pre-existing intellectual property. Access rights and ownership of jointly developed results are agreed for each cooperation.

7. Data protection

• Processing under a data processing agreement in line with GDPR.
• Processing in the European Union, or in your own environment.
• Your material is used for your project only, not to train general models, and is deleted when the pilot ends unless agreed otherwise.
• Access limited to the named engineers working on the pilot.

8. Proposed pilot

The timeline is indicative and is fixed together with you.

9. Company

Webinson s.r.o., Alžbetina 16, 040 01 Košice, Slovakia · webinson.com · [email protected]

15 years of software engineering. Webinson has developed Vocabulift since January 2023 and brought it to market in spring 2023. Other products include PitchPlace (campsite websites in 28 countries read into structured, translated records and matched against other sources), PitchPace (market intelligence), Spotibo (SEO tools) and Colorko (a creative platform).

Strata technology profile, version 2.2, 6 October 2026. Prepared by Webinson s.r.o. Online at vocabulift.com/partnership.