Understanding tbpl

https://tbpl.mozilla.org/

Andrew Halberstadt

irc: ahal

A tinderbox is a build or test machine

TBPL shows tinderbox results by order commits were pushed

TBPL = Tinderboxpushlog

Agenda

TBPL Basics - how to read it
What happens behind the scenes
Triaging failures
How to read and interpret logs
Advanced tips and tricks
Future of TBPL

Please ask questions throughout!

TBPL Basics

Demo

Resources

https://wiki.mozilla.org/Sheriffing/TBPL

test harness information

Desktop Firefox:

https://developer.mozilla.org/Mozilla/QA/Automated_testing

B2G:

https://developer.mozilla.org/Firefox_OS/Platform/Automated_testing

behind the scenes

triaging Failures

There is an error on your push! What do you do?

Step 1 - Determine if your patch is the cause

Look at previous pushes for the same failure
Look at auto-suggested bugs for known intermittents
Ask a sheriff
Ask the test creator/owner

Step 2 - Backout or tell a sheriff

If the commit caused the failure, it needs to be backed out

If you pushed to a sheriffed tree, you don't need to do anything

Otherwise, you are responsible for backing out the patch yourself.

Sheriffed trees: mozilla-inbound, b2g-inbound, etc.
Non-sheriffed: mozilla-central, mozilla-aurora, etc.

Step 3 - Fix and re-land

A good first step is figuring out what type of failure it is

Crash
Intermittent
Timeout
Out of memory
Infrastructure
etc...

Though this is harder than it sounds

Reading and interpreting logs

Live examples

advanced tips and tricks

Url Parameters

showall=1
jobname=b2g
rev=7d5fcd8a3a99
pusher=ahalberstadt@mozilla.com

Self serve

Starring
Retrigger
Cancel
Build directory

Commit keywords

DONTBUILD
CLOSED TREE

Orangefactor

Blob uploader

future of tbpl

TBPL will be replaced by Treeherder (aka TBPLv2) at some point in 2014

For more information:

https://wiki.mozilla.org/Auto-tools/Projects/Treeherder

Live staging instance:

http://treeherder.allizom.org/ui/#/jobs

questions?

Slides - https://slid.es/ahal/tbpl

Topics we covered:

TBPL basics
Behind the scenes
Triaging failures
Interpreting logs
Tips and Tricks
Future of TBPL