EngFlow Artifact Download

Download test logs and artifacts from EngFlow CI invocations (mesolite.cluster.engflow.com) using engflow_artifacts.py (co-located in this skill directory).

Prerequisites

The engflow_auth CLI must be installed and authenticated:

One-time login (opens browser for Google SSO)

engflow_auth login mesolite.cluster.engflow.com

Verify authentication

engflow_auth export mesolite.cluster.engflow.com

Quick Reference

The script is at .claude/skills/engflow-artifacts/engflow_artifacts.py and is directly executable (has a shebang). Run it from the repo root:

Command Purpose

targets <ID>

List failed targets in an invocation

list <ID> --target <LABEL>

List per-shard artifacts for a target

download <ID> --target <LABEL> --shard N

Download artifacts for a shard

blob <HASH> <SIZE>

Download a specific CAS blob

url '<FULL_URL>'

Download from a full EngFlow invocation URL

Typical Investigation Workflow

EF=.claude/skills/engflow-artifacts/engflow_artifacts.py

1. Find what failed

./$EF targets daa807a0-3589-40a5-94b5-3440c7490d6a

2. List shards for the failed target

./$EF list daa807a0-3589-40a5-94b5-3440c7490d6a
--target '//pkg/sql/ttl:ttl_test'

3. Download the failing shard's logs

./$EF download daa807a0-3589-40a5-94b5-3440c7490d6a
--target '//pkg/sql/ttl:ttl_test' --shard 100 --outdir /tmp/engflow-test

4. Read the test log

cat /tmp/engflow-test/test.log

5. Inspect extracted CockroachDB server logs from outputs.zip

ls /tmp/engflow-test/

Per-Shard Artifacts

Every shard has:

• test.xml — JUnit XML test results (referenced via CompactDigest: raw 32-byte SHA-256 hash)

• test.log — stdout/stderr from the test run (referenced via bytestream:// URL)

Some shards also have:

• outputs.zip — CockroachDB server logs captured during the test

• manifest — lists files in outputs.zip

How It Works

• engflow_auth export provides a JWT token.

• gRPC-web calls via curl to EngFlow's internal v1alpha ResultStore API (GetTarget, GetTargetLabelsByStatus).

• CAS blob downloads via curl with the auth token as a cookie.

• outputs.zip is auto-extracted after download.

• test.xml blobs are found by parsing engflow.type.CompactDigest entries (binary SHA-256 + uint64 size) from the protobuf response.

Python's urllib mangles headers in a way EngFlow rejects, so the script uses subprocess

• curl .

Extracted outputs.zip Structure

logTestName123456/ test.log # short log test.{node-id}.roach.{timestamp}.log # full structured log test-health.log # health channel test-storage.log # storage channel test-kv-distribution.log # KV distribution channel

URL Structure

Invocation page: https://mesolite.cluster.engflow.com/invocations/default/{INVOCATION_ID}

With filters: ?testReportRun=1&testReportShard={N}&testReportAttempt=1&treeFilterStatus=failed#targets-{BASE64_TARGET}

Tips

• Blob hashes are SHA-256. Sizes are in bytes.

• Use list to find which shard has outputs.zip (not all shards produce one).

• If engflow_auth export fails, re-authenticate with engflow_auth login mesolite.cluster.engflow.com .

• Default output directory is /tmp/engflow-artifacts .

• --all flag on targets shows both passed and failed targets.