Source profileQuality 84/100Review permissions

jianshuo/claude-skills/wjs-overlaying-video/SKILL.md

wjs-overlaying-video

Use when the user has one or more video clips and wants to add post-production on top — AI-generated cover as first frame, HTML/CSS captions synced to SRT, kinetic illustration overlays at hook moments, chapter chips, end-card CTA, or any other timed motion graphics. Most often used as the downstream of `/wjs-segmenting-video` — pick up where that skill stopped (raw cropped clip + per-clip SRT) and produce the upload-ready MP4. Backed by HyperFrames so everything compiles to ONE final encode — n

Source repository stars
112
Declared platforms
0
Static risk flags
2
Last source update
2026-08-02
Source checked
2026-08-04

Decision brief

What it does—and where it fits

Post-production for a video clip: cover, captions, illustrations, CTA, custom motion graphics — all composed in ONE HyperFrames project and rendered in a SINGLE final encode. No cascade of decodes/re-encodes (each cascade pass degrades quality and burns time).

Best for

  • Downstream of /wjs-segmenting-video — the segmentation skill
  • User has a finished video and wants to dress it up with motion
  • User wants HTML/CSS-quality captions on a video (kinetic word-by-word

Not for

  • Cover aspect ≠ output aspect. 1024x1536 (the default
  • Caption alignment jumps with line count. Anchor by CENTER

Compatibility matrix

Platform support, with evidence labels

PlatformStatusEvidenceWhat to check
CodexNot declaredNo explicit evidencePortability before use
Claude CodeNot declaredNo explicit evidencePortability before use
CursorNot declaredNo explicit evidencePortability before use
Gemini CLINot declaredNo explicit evidencePortability before use
Open the compatibility checker

Installation

Inspect first. Install second.

The source command is displayed only when detected. A safe inspection prompt is always available so your agent can explain every action before execution.

Source-detected install commandSource
npx skills add https://github.com/jianshuo/claude-skills --skill "wjs-overlaying-video"
Safe inspection promptEditorial

Inspect the Agent Skill "wjs-overlaying-video" from https://github.com/jianshuo/claude-skills/blob/82e33225aab9b2f5dcd6c8560d956b6794a13c0e/wjs-overlaying-video/SKILL.md at commit 82e33225aab9b2f5dcd6c8560d956b6794a13c0e. List every install step, command, network request, credential, file read/write, external action, and rollback step. Explain whether it fits my task. Do not install or execute anything until I approve.

Workflow

What the source asks the agent to do

  1. 01

    Workflow A — Post-segmentation preset (most common)

    Use this when you're coming directly from /wjs-segmenting-video and want the standard cover + caption + chapter + illustrations + CTA treatment for each clip.

    Use this when you're coming directly from /wjs-segmenting-video and want the standard cover + caption + chapter + illustrations + CTA treatment for each clip.
  2. 02

    Step 1 — Generate AI covers at the right aspect

    Review the “Step 1 — Generate AI covers at the right aspect” section in the pinned source before continuing.

    Review and apply the “Step 1 — Generate AI covers at the right aspect” source section.
  3. 03

    Step 2 — For each clip, scaffold a HyperFrames project

    hfclipNN/1080/ with: - index.html — the composition (from template; see references/postsegmentationtemplate.html) - clip.mp4 — copied from output/clipNNslug.mp4 - cover.png — copied from output/coverNNslug.png - captions.json — generated from output/clipNNslug.zh-CN.burn.srt wit…

    index.html — the composition (from template; seeclip.mp4 — copied from output/clipNNslug.mp4cover.png — copied from output/coverNNslug.png
  4. 04

    Step 3 — Define illustrations per clip

    For each clip, identify 1-2 hook moments and pick stack or hammer:

    For each clip, identify 1-2 hook moments and pick stack or hammer:Timestamps are body-relative (after the cover-scene duration); the build script adds the cover offset when emitting GSAP positions.
  5. 05

    Step 4 — Build + render

    A 2:30 clip renders in 3 min. Output: hfclipNN/1080/renders/.mp4.

    A 2:30 clip renders in 3 min. Output: hfclipNN/1080/renders/.mp4.

Permission review

Static risk signals and limitations

Runs scripts

medium · line 57

The documentation asks the agent to run terminal commands or scripts.

npm run render → upload-ready MP4

Network access

medium · line 199

The documentation includes network, browsing, or remote request actions.

<link rel="preconnect" href="https://fonts.googleapis.com">

Network access

medium · line 200

The documentation includes network, browsing, or remote request actions.

<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>

Runs scripts

medium · line 439

The documentation asks the agent to run terminal commands or scripts.

python3 ~/.claude/skills/wjs-segmenting-video/scripts/make_cover.py \

Evidence record

Why each signal appears

EvidenceSourceComputedTestedEditorial
SignalValueEvidence typeMeaning
Quality score84/100ComputedDocumentation, specificity, maintenance, and trust rules
Repository stars112SourceRepository attention, not individual Skill quality
Compatibility0 platformsSourceDeclared in the catalog source record
Usage guideautomated source guideEditorialGenerated or reviewed according to the visible evidence level

Pinned source

Provenance and original SKILL.md

Repository
jianshuo/claude-skills
Skill path
wjs-overlaying-video/SKILL.md
Commit
82e33225aab9b2f5dcd6c8560d956b6794a13c0e
License
MIT
Collected
2026-08-04
Default branch
main
View the original SKILL.md

wjs-overlaying-video

Post-production for a video clip: cover, captions, illustrations, CTA, custom motion graphics — all composed in ONE HyperFrames project and rendered in a SINGLE final encode. No cascade of decodes/re-encodes (each cascade pass degrades quality and burns time).

When to use

  • Downstream of /wjs-segmenting-video — the segmentation skill hands you cropped clips + per-clip SRTs; this skill turns them into upload-ready MP4s with cover/captions/illustrations/CTA.
  • User has a finished video and wants to dress it up with motion graphics: opening hook, key-quote callout, closing slogan, chapter cards, AI-generated cover as first frame.
  • User wants HTML/CSS-quality captions on a video (kinetic word-by-word highlighting, custom fonts, large outlined text, seekable per cue).
  • User wants illustration overlays at specific hook moments — diagrams, big text emphasis, flow charts.

Don't use for:

  • Splitting one long video into clips → use /wjs-segmenting-video.
  • Creating the source SRT → use /wjs-transcribing-audio (then /wjs-translating-subtitles if you need a different language).
  • Full HyperFrames productions where the source isn't a fixed video → use hyperframes directly.
  • 微信视频号 / 抖音 upload (no public API for those) → this skill produces the MP4; upload is manual.

What this skill IS — and IS NOT

IsIs not
Everything that goes ON TOP of a video clip: cover, caption, chapter, illustration, CTACutting / cropping a video (that's /wjs-segmenting-video + /wjs-reframing-video)
One HyperFrames composition per clip = ONE final encodeA multi-step decode/encode cascade
cover is the literal first frame of the output (platforms auto-pick it as thumbnail)A separate thumbnail file the user uploads alongside
Captions are HTML/CSS — -webkit-text-stroke for white-on-anything readabilitylibass burn-in (deprecated)
Illustrations: re-usable stack / hammer patterns + custom escape hatchOne bespoke HTML/CSS per illustration without re-use
AI covers regenerated at native target aspect (1024×1792 for vertical, 1536×1024 for horizontal)Single 1024×1536 default that letterboxes or crops on the platform

The pipeline

clip.mp4 + clip.zh-CN.burn.srt   (from /wjs-segmenting-video hand-off)
   ↓
1. (Optional) Generate AI cover via gpt-image-2
   make_cover.py --segments S.json --out output/ --size 1024x1792
   cover_NN_slug.png

2. Scaffold a HyperFrames project per clip
   hf_clip_NN/1080/{index.html, clip.mp4, cover.png, captions.json}

3. Compose: cover scene + body video + caption track + chapter chip
            + 1-2 illustrations at hook moments + CTA scene

4. npm run check (lint + validate + visual inspect)
   npm run render → upload-ready MP4

A 2-minute vertical 1080×1920 composition renders in ~2-3 min on M-series Mac.

Color: tone-map HLG/HDR source → SDR BEFORE compositing

Only tone-map genuinely HLG/HDR sources. If the body clip is ALREADY Rec.709 SDR — e.g. a graded multicam render, or polysync output where an S-Log3→709 LUT was already applied — running the HLG tone-map recipe on it washes/darkens the already-correct color. build_hf_clips.py's tonemap_to_sdr now probes color_transfer (_is_hlg_hdr): HLG/PQ → tone-map; otherwise a straight re-encode with dense keyframes (no tone-map). Either way you still get the -g 30 dense-keyframe encode HyperFrames needs.

iPhone / modern-camera footage is often HLG HDR (bt2020 / arib-std-b67). If you feed that straight into HyperFrames it either renders washed-out ("发白") or, with a naive --sdr, too dark ("发黑"); and the HDR x265 path can hang the renderer. Pre-convert the body clip to SDR (bt709) 30fps h264 with a locked zscale tone-map, then composite the SDR clip.

The verified recipe (tonemap_to_sdr() in build_hf_clips.py). npl=203 matches macOS-native (qlmanage) reference brightness; hable keeps contrast; this preserves the ORIGINAL look (natural skin / foliage / brick), no wash, no darkening:

# zscale-capable ffmpeg — Homebrew's lacks zscale/tonemap.
# imageio-ffmpeg ships one: .../imageio_ffmpeg/binaries/ffmpeg-macos-aarch64-v7.1
TONEMAP_VF = ("zscale=tin=arib-std-b67:min=bt2020nc:pin=bt2020:t=linear:npl=203,"
              "format=gbrpf32le,tonemap=tonemap=hable:desat=0,"
              "zscale=t=bt709:m=bt709:p=bt709:r=tv,format=yuv420p,fps=30")
# encode: libx264 -crf 18 -color_primaries/-trc/-colorspace bt709
#         -g 30 -keyint_min 30 -movflags +faststart   ← see gotcha below

Dense-keyframe gotcha. HyperFrames seeks the body video frame-by-frame. A clip with sparse keyframes (long GOP) makes it freeze on stale frames — the render log warns Video "video" has sparse keyframes. Always encode the SDR clip with -g 30 -keyint_min 30 (one keyframe per frame-second) so every seek lands clean.

Verify the render log says No HDR sources detected — rendering SDR. If it says HDR detected, your clip wasn't tone-mapped — fix that first.

Version stamp (every output)

Stamp 「skill名字 + 版本号」 bottom-right, shown during the END/CTA scene, so every render is traceable to the pipeline version that made it. Bump VERSION in build_hf_clips.py on each pipeline change.

#ver-stamp { position: absolute; right: 28px; bottom: 28px; z-index: 30;
  font-size: 20px; color: rgba(150,150,156,0.55); letter-spacing: 0.06em; }
<div id="ver-stamp" class="clip" data-start="{cta_start}" data-duration="{cta_dur}"
     data-track-index="2">wjs-overlaying-video v1.3</div>

Standard overlay types (the 6 building blocks)

Every clip's final composition is built from some combination of these. The agent picks the right ones per clip — typically all 6 for a podcast highlight, or just 1-2 for a single annotation overlay.

1. cover — full-frame AI image as first frame

The cover IS the first frame (no animation, no zoom) so platforms that auto-pick the first frame as the thumbnail get your designed cover by default. Always verify with ffmpeg -ss 0 -vframes 1 — frame 0 must NOT be black or platform thumbnails will be black.

HTML:

<div id="cover" class="clip" data-start="0" data-duration="1.6"
     data-track-index="1" data-layout-allow-overflow>
  <img src="cover.png" alt="" data-layout-allow-overflow />
</div>

CSS:

#cover { position: absolute; inset: 0; background: #0c0d10; overflow: hidden; }
#cover img { position: absolute; inset: 0; width: 100%; height: 100%; object-fit: cover; }

Generation: use /wjs-segmenting-video/scripts/make_cover.py (wraps gpt-image-2 images edit with the midpoint frame as ref):

# For 1080×1920 vertical output (视频号 / 抖音):
make_cover.py --segments S.json --out output/ --size 1024x1792 [--single N]

# For 1920×1080 horizontal output (YouTube / B站):
make_cover.py --segments S.json --out output/ --size 1536x1024

Aspect must match output frame. --size 1024x1536 (2:3, the script default) gets letterboxed or cropped on 9:16 output — always pass 1024x1792 for vertical. The cover image's aspect is what the viewer sees full-frame, so mismatch is visible. Re-roll one with --single N; codex provider can transient-fail mid-batch.

Codex auth required: the script calls codex CLI via gpt-image-2-skill. If ~/.codex/auth.json is missing, the script errors. See gpt-image-2-skill for setup.

Reference frame must match the OUTPUT orientation. make_cover reads output/frame_NN_slug.jpg as the photographic background it keeps. For a vertical clip that came from a horizontal two-person source, the default frame_NN is the horizontal two-shot — feeding that to a 1024x1792 cover crams both people into portrait awkwardly. Replace frame_NN_slug.jpg with a vertical single-speaker frame pulled from the already-cropped body clip first (ffmpeg -ss <t> -i clip_vert.mp4 -frames:v 1 frame_NN_slug.jpg), then run make_cover. The cover then matches the body framing.

Baked-title cover ⇒ drop the animated #hook opener. make_cover stamps the segment title into the cover image (white fill + heavy black stroke, placed clear of faces). That cover IS the title card. Do NOT also run the animated #hook opener over it (overlay type below) — you'd double-stamp the title. Pick one: either a make_cover baked-title cover (then leave HOOK empty), or a plain video-frame cover + animated hook. The house default the user approved is the make_cover baked-title cover (a clean video frame with the title burned in, no AI painting).

2. caption — 关键词高亮 captions (字幕风格 03) synced to SRT

Chosen style for 王建硕 (user-approved): 字幕风格 03「关键词高亮」+ 思源宋体 Noto Serif SC. Serif white text with a black stroke, and punchy QUANTITATIVE keywords (倍数 / 大数量级 / 百分比) wrapped in a small gold gradient block. Captions are vertically centered in a fixed zone (so 1-line vs 2-line cues don't make the visual center jump up and down).

There were 4 candidate styles (描边白字 / 质感底条 / 关键词高亮 / 逐字点亮); the user picked 03 关键词高亮 with serif sc font. Use that. The plain-stroke style (-webkit-text-stroke: 5px #000, no gold block, sans font) is the fallback if a clip has no quantitative keywords to highlight.

Font — load Noto Serif SC from Google Fonts in <head> (the HyperFrames compiler fetches & inlines requested Google font families automatically; verify the render log says Fetched … Noto Serif SC):

<link rel="preconnect" href="https://fonts.googleapis.com">
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
<link href="https://fonts.googleapis.com/css2?family=Noto+Serif+SC:wght@600;700;900&display=swap" rel="stylesheet">

HTML:

<div id="caption" class="clip" data-start="{body_start}"
     data-duration="{body_dur}" data-track-index="4"></div>

CSS (vertical 1080×1920) — 字幕风格 03:

#caption {
  position: absolute; left: 0; right: 0; bottom: 240px;
  height: 240px; z-index: 10; overflow: visible;
}
#caption .bubble {
  position: absolute; top: 50%; left: 50%;
  display: inline-block; padding: 0 24px;
  font-family: "Noto Serif SC", "Songti SC", "STSong", serif;
  font-size: 52px; line-height: 1.32; font-weight: 700;
  color: #fff; max-width: 980px; text-align: center;
  -webkit-text-stroke: 2.5px rgba(0,0,0,0.9);
  paint-order: stroke fill;
  text-shadow: 0 2px 8px rgba(0,0,0,0.7), 0 0 2px rgba(0,0,0,0.9);
  letter-spacing: 0.01em;
}
#caption .bubble .hot {        /* gold keyword block */
  color: #1a1206; -webkit-text-stroke: 0;
  background: linear-gradient(180deg, #f3c877, #c79655);
  padding: 2px 12px; border-radius: 9px; margin: 0 3px;
  box-shadow: 0 3px 10px -3px rgba(232,176,99,0.6);
}

Keyword auto-selection (sparse on purpose). Wrap only genuinely emphatic magnitudes so the gold block stays meaningful, not noisy. Deliberately EXCLUDE generic 个/年 ("一个", "20年"). Handles thousands-commas ("1,000万"). build_hf_clips.py does this in mark_keywords():

_NUM = r"[0-90-9,,一二三四五六七八九十百千两零几]+"
_HOT_RE = re.compile(rf"(?:翻了?{_NUM}?[倍番]|{_NUM}\s*(?:[倍番]|万亿?|亿|%|%))")
# → highlights: 一倍 五六倍 十倍 10倍 50万 800万 1,000万 50% 翻一倍
# render the cue with b.innerHTML = g.html (HTML-escape the non-keyword text)

JS (one bubble per cue + GSAP fade in/out, all centered at container midpoint):

// SRT cues are loaded as inline JSON. Each cue's start/end is offset
// by the cover-scene duration (e.g., 1.5s) so the timing aligns with
// the composition timeline (not the body's own t=0).
const captionEl = document.getElementById("caption");
const groups = JSON.parse(document.getElementById("captions-data").textContent);
const bubbles = groups.map((g, i) => {
  const b = document.createElement("span");
  b.className = "bubble"; b.id = "cap-" + i;
  b.innerHTML = g.html || g.text;   // g.html has <span class="hot"> keyword blocks
  b.style.opacity = "0";
  captionEl.appendChild(b);
  return b;
});
// GSAP xPercent/yPercent for centering (CSS transform would get
// overwritten the moment we tween y).
gsap.set(bubbles, { xPercent: -50, yPercent: -50 });
groups.forEach((g, i) => {
  const el = bubbles[i];
  tl.fromTo(el, { opacity: 0, y: 12 }, { opacity: 1, y: 0, duration: 0.18, ease: "power2.out" }, g.start);
  const exitStart = Math.max(g.start + 0.18, g.end - 0.12);
  tl.to(el, { opacity: 0, duration: 0.12, ease: "power2.in" }, exitStart);
  tl.set(el, { opacity: 0 }, g.end);
});

Source SRT — slice + shift before inlining. Prefer the word-timed .asr.srt built by /wjs-transcribing-audio (火山 streaming ASR → build_srt_from_asr.py) — its per-word timing means cues sit exactly on the spoken audio with no drift. Parse each cue, add the cover duration to every start/end, run mark_keywords() to produce the html field, and inline as JSON in a <script id="captions-data" type="application/json"> block.

MarginV / position notes:

  • Vertical (1080×1920): bottom: 240px keeps captions clear of the 视频号/抖音 bottom UI overlay (likes/comments/share buttons).
  • Horizontal (1920×1080): bottom: 100px, font-size: 48px, -webkit-text-stroke: 4px is a reasonable default.

Caption length cap. If a single cue exceeds ~18 Chinese chars on 1080-wide at 56px, it wraps to 2 lines awkwardly. This is upstream discipline — /wjs-translating-subtitles should cap cues at ~18 chars using word-gap split + punctuation split. If you receive longer cues, either reduce font-size to 48px or accept the wrap.

3. chapter — top-left chapter chip (4s reveal then fade)

A subtle badge identifying the segment. Enters at body start, fades after a few seconds so it doesn't compete with the rest of the composition.

HTML:

<div id="chapter" class="clip" data-start="{body_start}"
     data-duration="{body_dur}" data-track-index="3">
  <span class="dot"></span>
  <span class="text">第一段 · 自然语言才是新代码</span>
</div>

CSS:

#chapter {
  position: absolute; top: 80px; left: 60px; z-index: 9;
  display: inline-flex; align-items: center; gap: 12px;
  padding: 12px 20px;
  background: rgba(12,13,16,0.78);
  border: 1px solid rgba(199,150,85,0.4);
  border-radius: 999px;
}
#chapter .dot { width: 10px; height: 10px; border-radius: 999px; background: #e8b063; }
#chapter .text {
  font-size: 24px; color: #f4f4f5; letter-spacing: 0.04em; font-weight: 600;
}

GSAP:

tl.from("#chapter", { x: -40, opacity: 0, duration: 0.5, ease: "expo.out" }, body_start + 0.4);
tl.to("#chapter", { opacity: 0, duration: 0.4, ease: "power2.in" }, body_start + 4.0);

4. stack illustration — top-right vertical list card

A list of items (e.g., language hierarchy, workflow steps, levels) in a dark card at the top-right. One item can be accented in amber to highlight the relevant level/step.

Use for: showing a hierarchy or list while the speaker explains it. Card stays visible 8-50s.

HTML:

<div id="ill-stack" class="clip" data-start="{start}" data-duration="{dur}" data-track-index="5">
  <div class="ill-card">
    <div class="ill-card-label">我们写的层级</div>
    <div class="ill-row"><span class="ill-tag accent">自然语言</span></div>
    <div class="ill-row"><span class="ill-tag">Python</span></div>
    <div class="ill-row"><span class="ill-tag">C</span></div>
    <div class="ill-row"><span class="ill-tag">Assembly</span></div>
  </div>
</div>

CSS: (see references/illustration_patterns.md for the full canonical CSS — copy verbatim)

GSAP — slide in from right + stagger rows:

tl.fromTo("#ill-stack", { x: 360, opacity: 0 }, { x: 0, opacity: 1, duration: 0.6, ease: "expo.out" }, start + 0.2);
tl.from("#ill-stack .ill-row", { y: 20, opacity: 0, duration: 0.4, stagger: 0.12, ease: "power2.out" }, start + 0.4);
tl.to("#ill-stack", { x: 360, opacity: 0, duration: 0.5, ease: "power2.in" }, end - 0.5);

5. hammer illustration — center-frame big equation/text overlay

A BIG center-frame text/equation that visually "hammers" a key claim. Best for the single most quotable moment in a clip (e.g., "LLM = 编译器", "Token = 新 GDP", "AI ≠ 更快的轿子"). Visible 4–8s.

HTML:

<div id="ill-hammer" class="clip" data-start="{start}" data-duration="{dur}" data-track-index="6">
  <div class="ill-h-content">
    <div class="ill-h-eq">
      <span class="ill-h-left">LLM</span>
      <span class="ill-h-equals">=</span>
      <span class="ill-h-right">新编译器</span>
    </div>
    <div class="ill-h-foot">自然语言 → Python → 汇编</div>
  </div>
</div>

GSAP — scale-pop entrance + stagger each piece + scale-fade exit:

tl.fromTo("#ill-hammer", { scale: 0.85, opacity: 0 },
  { scale: 1.0, opacity: 1, duration: 0.45, ease: "back.out(1.6)" }, start);
tl.from("#ill-hammer .ill-h-left", { x: -40, opacity: 0, duration: 0.4, ease: "expo.out" }, start + 0.2);
tl.from("#ill-hammer .ill-h-equals", { scale: 0, opacity: 0, duration: 0.4, ease: "back.out(2)" }, start + 0.4);
tl.from("#ill-hammer .ill-h-right", { x: 40, opacity: 0, duration: 0.4, ease: "expo.out" }, start + 0.6);
tl.from("#ill-hammer .ill-h-foot", { y: 20, opacity: 0, duration: 0.4, ease: "power2.out" }, start + 0.8);
tl.to("#ill-hammer", { scale: 1.05, opacity: 0, duration: 0.45, ease: "power2.in" }, end - 0.45);

(see references/illustration_patterns.md for full canonical CSS)

6. cta — end-card with channel CTA

A branded outro for the final 3 seconds. Use 王建硕 as the channel name (per global instructions) — never put a guest's name in the CTA slot.

HTML:

<div id="cta" class="clip" data-start="{cta_start}" data-duration="3.24" data-track-index="1">
  <div class="cta-line-1">关注王建硕</div>
  <div class="arrow">↓</div>
  <div class="cta-line-2">微信公众号 · 视频号</div>
  <div class="cta-foot">聊 AI · 聊创业 · 持续更新</div>
</div>

CSS / GSAP: see references/illustration_patterns.md.

Legacy types (for one-off overlays on a single video)

The spec.json + scaffold.py workflow also supports these older overlay types — useful when you want to dress up ONE existing video without going through the full post-production workflow above:

  • quote — full-width kinetic typography, top or bottom gradient. Best for opening hooks and key-quote callouts.
  • slogan — alias for quote with position: bottom and larger type. Best for closing slogans.
  • callout — small annotation panel in a corner. Best for chapter labels, lower-thirds, "as seen in" notes.
  • custom — escape hatch. Claude writes the overlay's HTML/CSS/GSAP inside an overlays/<name>.html fragment file. See references/custom_overlay_recipes.md.

Workflow A — Post-segmentation preset (most common)

Use this when you're coming directly from /wjs-segmenting-video and want the standard cover + caption + chapter + illustrations + CTA treatment for each clip.

Step 1 — Generate AI covers at the right aspect

# For vertical 9:16 output (视频号 / 抖音):
python3 ~/.claude/skills/wjs-segmenting-video/scripts/make_cover.py \
    --segments segments.json --out output/ --size 1024x1792 --single 1
# Verify segment 1's cover; then batch:
python3 ~/.claude/skills/wjs-segmenting-video/scripts/make_cover.py \
    --segments segments.json --out output/ --size 1024x1792

Step 2 — For each clip, scaffold a HyperFrames project

hf_clip_NN/1080/ with:

  • index.html — the composition (from template; see references/post_segmentation_template.html)
  • clip.mp4 — copied from output/clip_NN_slug.mp4
  • cover.png — copied from output/cover_NN_slug.png
  • captions.json — generated from output/clip_NN_slug.zh-CN.burn.srt with every cue's start/end shifted by +cover_duration (so cues align with the composition timeline, not the body's own clock)

The build script at references/build_hf_clips.py does this for all segments in one pass. It reads segments.json + an ILLUSTRATIONS dict (illustrations per clip, see Step 3) + the template, and emits 5 ready-to-render projects.

Step 3 — Define illustrations per clip

For each clip, identify 1-2 hook moments and pick stack or hammer:

ILLUSTRATIONS = {
    1: [
        # The language hierarchy as a stack card during the opening
        {"key": "stack", "pattern": "stack", "body_start": 0.3, "body_end": 9.0,
         "label": "我们写的层级",
         "rows": [
             {"text": "自然语言", "accent": True},
             {"text": "Python",   "accent": False},
             {"text": "C",        "accent": False},
             {"text": "Assembly", "accent": False},
         ]},
        # The hammer at the most quotable moment
        {"key": "hammer", "pattern": "hammer", "body_start": 10.8, "body_end": 14.6,
         "left": "LLM", "equals": "=", "right": "新编译器",
         "foot": "自然语言 → Python → 汇编"},
    ],
    # ... clips 2-5
}

Timestamps are body-relative (after the cover-scene duration); the build script adds the cover offset when emitting GSAP positions.

Step 4 — Build + render

python3 references/build_hf_clips.py    # scaffolds all projects
for n in 01 02 03 04 05; do
  cd "hf_clip_$n/1080"
  npx hyperframes lint
  npx hyperframes validate
  npx hyperframes render
  cd ../..
done

A 2:30 clip renders in ~3 min. Output: hf_clip_NN/1080/renders/*.mp4.

Workflow B — Custom overlays on a single video (legacy spec.json)

Use this when you have ONE existing video and want to add a few ad-hoc overlays (title cards, annotations, lower-thirds).

spec.json schema

{
  "source_video": "../path/to/source.mp4",
  "duration": 135.4,
  "size": "1920x1080",
  "name": "clip_01_animated",
  "overlays": [
    {"id": "o1", "type": "quote", "start": 8.0, "duration": 6.0,
     "position": "top", "lines": ["代码不存在错误", "只存在意图错配"],
     "accent": [false, true]},
    {"id": "o2", "type": "callout", "start": 30.0, "duration": 5.0,
     "anchor": "top-right", "text": "FRP 概念"},
    {"id": "o3", "type": "slogan", "start": 122.0, "duration": 13.4,
     "lines": ["改 prompt", "不改 AI 生成的代码"], "accent": [false, true]}
  ]
}
FieldRequiredNotes
source_videoYesPath to source MP4. Symlinked into the project as source.mp4.
durationYesTotal composition length in seconds — match the source video.
sizeNoWIDTHxHEIGHT (default 1920x1080).
overlays[].typeYesquote, slogan, callout, or custom.
overlays[].startYesStart time in seconds.
overlays[].durationYesHow long the overlay is on screen.

Scaffold + render

python3 ~/.claude/skills/wjs-overlaying-video/scripts/scaffold.py spec.json
cd <name> && npm run check && npm run render

Output checklist

Before considering a clip done:

  • Frame 0 is the cover (not black) — ffmpeg -ss 0 -vframes 1 out.mp4
  • Captions are synced with audio (lint a few seconds with audio playback)
  • All illustrations enter and exit at the speech moments they support
  • CTA renders correctly (关注王建硕, not a guest's name)
  • npx hyperframes lint && npx hyperframes validate both pass
  • npx hyperframes inspect shows no layout overflow
  • Total duration matches the source clip + cover + CTA durations

Common mistakes

  • Cover aspect ≠ output aspect. 1024x1536 (the default make_cover.py size) is 2:3 and gets letterboxed or cropped on 9:16 output. Always pass --size 1024x1792 for vertical.
  • Caption alignment jumps with line count. Anchor by CENTER (translate(-50%, -50%)) inside a fixed-height container so 1-line vs 2-line cues share the same visual midline. NOT anchored from bottom (causes growth-upward).
  • GSAP overwrites CSS transform centering. If you set transform: translate(-50%, -50%) in CSS and then tween y, GSAP replaces the transform and centering breaks. Use gsap.set(el, { xPercent: -50, yPercent: -50 }) instead so xPercent/yPercent compose with subsequent y/x tweens.
  • Burning libass subs on top of HTML/CSS captions. Pick ONE caption system per output video. If you're using this skill's HTML/CSS captions, do NOT also burn subs in /wjs-segmenting-video — request the raw clip via the hand-off package.
  • Frame 0 is black. If your cover scene has an opacity fade-in starting from 0, the literal first frame is black and the platform thumbnail will be black. Place the cover statically (no opacity tween) and verify with ffmpeg -ss 0 -vframes 1.
  • Channel name in CTA = guest's name. Always use 王建硕. Guests belong in description text inside the metadata, not in the on-screen CTA.
  • Cover image cropped because of object-fit: cover on mismatched aspect. Either regenerate the cover at the right aspect (see Step
    1. or letterbox with object-fit: contain + dark background.

Integration with other skills

  • /wjs-segmenting-video — the typical upstream. After it cuts
    • crops + slices SRTs, this skill picks up. The hand-off package is clip_NN.mp4 + clip_NN.zh-CN.burn.srt + segments.json.
  • /wjs-transcribing-audio + /wjs-translating-subtitles — if no SRT exists, run them first. The word-level Whisper or Volcano/豆包 ASR output is preferred for accurate cue timing.
  • hyperframes — the underlying composition framework. This skill is a thin wrapper that encodes the proven post-production patterns; everything in the hyperframes skill applies (preview, render, transitions, audio-reactive, etc.). Read it whenever you write custom overlays.
  • hyperframes-cli — the CLI commands the project uses (init, lint, validate, inspect, render).
  • gpt-image-2-skill — the cover generator. make_cover.py invokes it via the codex CLI; the codex auth in ~/.codex/auth.json is required.
  • /wjs-uploading-video — the next downstream after this skill produces an MP4. Uploads the renders to YouTube with title / description / tags from a metadata file.

Files & references

  • scripts/scaffold.py — Workflow B scaffolder (legacy spec.json for ad-hoc overlays)
  • references/post_segmentation_template.html — Workflow A template: the canonical cover + caption + chapter + illustration + CTA composition shape, with placeholder substitutions
  • references/build_hf_clips.py — Workflow A multi-clip builder. Reads segments.json + per-clip illustrations dict, scaffolds and populates one project per clip
  • references/illustration_patterns.md — canonical CSS / GSAP for the stack and hammer illustration patterns
  • references/custom_overlay_recipes.md — reusable custom overlay recipes (terminal demo, layer-stack diagram, callout with arrow)
  • references/example_spec.json — Workflow B example