7e828cbd61
Replaced convert_cookies.py + run_corpus.py + dedupe_corpus.py (+ the scratch merge_corpus.py) with a single extract_corpus.py that: converts cookies, fetches each URL's full conversation, MERGES overlapping conversations into one thread (union of posts, no duplicate threads/media), downloads ALL media (images + video/mp4) via gallery-dl itself (plain urllib 403'd on pbs.twimg.com and never fetched videos), and renders. Result: 4 merged threads, 33 media files (incl mp4), 0 missing links. cookies_netscape.txt gitignored.
38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
.env
|
|
.coverage
|
|
.slop_cache
|
|
.ruff_cache
|
|
.pytest_cache
|
|
.mypy_cache
|
|
__pycache__
|
|
credentials.toml
|
|
uv.lock
|
|
md_gen
|
|
scripts/generated
|
|
logs
|
|
logs/sessions/
|
|
logs/agents/
|
|
logs/errors/
|
|
tests/artifacts/
|
|
!tests/artifacts/manualslop_layout_default.ini
|
|
dpg_layout.ini
|
|
tests/temp_workspace
|
|
tests/.test_durations.json
|
|
sdm_report_refined.json
|
|
session-ses_1eb8.md
|
|
mock_debug_prompt.txt
|
|
temp_old_gui.py
|
|
.slop_cache/summary_cache.json
|
|
.antigravitycli
|
|
.vscode
|
|
.coverage
|
|
|
|
# Video analysis campaign artifacts (per conductor/archive/analysis/video_analysis_campaign_20260621/spec.md FR8)
|
|
# (campaign archived 2026-06-23; tracks moved from conductor/tracks/ to conductor/archive/analysis/)
|
|
conductor/archive/analysis/video_analysis_*/artifacts/*.mp4
|
|
conductor/archive/analysis/video_analysis_*/artifacts/*.vtt
|
|
# video.log intentionally committed (small text, useful for debugging)
|
|
conductor/archive/analysis/video_analysis_deob_warmup_20260621/samples
|
|
scripts/twitter_threads/cookies.txt
|
|
conductor/tracks/twitter_threads_extraction_20260705/cookies_netscape.txt
|