Issues with macOS builds

Incident Report for Bitrise

Resolved

Build queues are back at normal levels, we don't know about any ongoing issue. If you'd still experience any problem, please let us know!

Once again we're terribly sorry for the inconvenience this issue might have caused, and we'll make sure this issue will not happen again!
Posted Jul 05, 2016 - 20:51 UTC

Monitoring

The fix we applied is working, the system is back at it's normal state but there's still a significant build queue, which means new builds might be delayed before actually starting. We expect that the queue will get back to normal levels in 30-60 minutes. Until that we're closely monitoring the system.
Posted Jul 05, 2016 - 20:19 UTC

Identified

We believe we found the root cause of the issue, and applied the required fix. At this time it seems virtual machines are provisioned successfully, but we're still monitoring the system.

There's also a significant build queue now on the macOS stacks, so it will take some time while the system goes through the pending builds.

We're terribly sorry for the inconvenience, and we're doing everything we can to restore the system to it's ideal state.
Posted Jul 05, 2016 - 19:28 UTC

Investigating

We detected issues with macOS builds, where the system fails to provision a virtual machine for the build, and keeps retrying. We're doing everything we can do solve the issue as soon as possible.
Posted Jul 05, 2016 - 18:54 UTC