- Blobber -

Use it nicely,  use it wisely


Mihai Tabara @ Mozilla RelEng 2013 intern

IRC:  mtabara

About releng ...

Who am I?

I'm a student

I *love* hiking

I love skiing

I enjoy running

Again about releng ...


              • what do we do?
              • what are we?
              • what are we not?
              • truth be told ...


Changeset cycle



Tinderbox push log



Changeset cycle


What did i do?




  behind a happy user, there's a need for a happy developer

What did i do?

What did i do?

What did i do?


  • Codename: Blobber
  • Mission: break logs *text* boundaries!
  • Bug #: 749421

What did i do?

We've begun with ...
  • no more 64-encoded images
  • dump files as you wish

Side effects:
  1. xpcshell xUnit results for builds
  2. profiler for Talos
  3. code coverage for builds
  4. resource monitoring result to file
  5. B2G mozharness jobs save logcat


Join the club. We have jackets!

What did i do?

  • log enhancement 
  • less is more
  • break logs text boundaries

What did i do?

MOZ_UPLOAD_DIR

Blobuploader



  • Python package
  • PuppetAgain and Pypi
  • all_from(MOZ_UPLOAD_DIR) => blobserver

Blob server

  • gateway
    • auth/credentials/client allowance
    • allowed file types
    •  allowed sizes
  • elasticbeanstalk farm

Security

  • HTTP auth
  • SSL
  • IP whitelisting
  • VPC elasticbeanstalk farm
  • Mozilla VPN only


POST for only, accessible for everyone


Deployment




Example



Current state


In conclusion ...


Blobber - use it nicely, use it wisely

By Mihai Tabara

Blobber - use it nicely, use it wisely

mtabara's intern presentation @ Mozilla RelEng Team 2013

  • 358