Bitrise.io Status
All Systems Operational
Web App Operational
90 days ago
99.99 % uptime
Today
Scheduler Operational
90 days ago
100.0 % uptime
Today
Bitrise Virtual Device Testing ? Operational
90 days ago
100.0 % uptime
Today
Build Processing Operational
90 days ago
99.93 % uptime
Today
OS X Stack (iOS, Xamarin, ...) ? Operational
90 days ago
99.95 % uptime
Today
Linux Stack (Android, web projects, ...) ? Operational
90 days ago
99.91 % uptime
Today
Third Party Integrations Operational
Heroku ? Operational
DigitalOcean ? Operational
Recurly API ? Operational
DNSimple Name Servers Operational
Google Compute Engine ? Operational
Atlassian Bitbucket API Operational
Atlassian Bitbucket Git via HTTPS Operational
Atlassian Bitbucket SSH Operational
Atlassian Bitbucket Webhooks Operational
Atlassian Bitbucket Website Operational
AWS s3-us-standard Operational
AWS s3-us-west-1 Operational
AWS s3-us-west-2 Operational
Redis Labs GCE/us-central1-1-1 Operational
Intercom Intercom APIs Operational
Intercom Web Application - On-site Support Chat Operational
Intercom Admin notifications Operational
Intercom Medium message delivery Operational
Intercom Mobile Messenger Operational
Intercom Large message delivery Operational
Intercom Small message delivery Operational
Intercom Web Messenger Operational
Intercom Intercom Mobile APIs Operational
Intercom Intercom Webhooks Operational
Bintray Downloads Operational
Bintray REST API Operational
GitHub API Requests Operational
GitHub GitHub Pages Operational
GitHub Issues, PRs, Dashboard, Projects Operational
GitHub Visit www.githubstatus.com for more information Operational
GitHub Notifications Operational
GitHub Git Operations Operational
GitHub Gists Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
had a major outage
had a partial outage
Past Incidents
Mar 26, 2019

No incidents reported today.

Mar 25, 2019

No incidents reported.

Mar 24, 2019

No incidents reported.

Mar 23, 2019

No incidents reported.

Mar 22, 2019

No incidents reported.

Mar 21, 2019

No incidents reported.

Mar 20, 2019

No incidents reported.

Mar 19, 2019

No incidents reported.

Mar 18, 2019

No incidents reported.

Mar 17, 2019

No incidents reported.

Mar 16, 2019

No incidents reported.

Mar 15, 2019
Resolved - This incident has been resolved.
Mar 15, 12:39 UTC
Monitoring - Queues cleared out.
Mar 15, 11:46 UTC
Identified - We are experiencing high queues on our Xcode 10.1 stack.

Unfortunately, we are still seeing queues on the Xcode 10.1 stacks. In the past couple of days our infra team deployed multiple possible solutions to our production system and have also been working on upgrading our machine park along with the underlying storage layer itself. Sadly the previous configuration changes only managed to ease the issue with the build times and queues, but didn't manage to fully solve them. Currently we are working on adding new machines and additional storage to our machine park as well as reworking our whole build load balancing logic to be able to handle the increased load generated by the current traffic.

For more in-depth information on the cause of this issue and the steps we're taking to ensure it won't happen again, please check out our blogpost on this topic: https://blog.bitrise.io/update-mac-infrastructure-queues-march-2019

We are really sorry for the inconvenience caused by this issue, but are doing everything in our power to ensure performance is where it needs to be as soon as possible.
Mar 15, 10:44 UTC
Mar 14, 2019
Resolved - The queues are back to normal and the builds should be starting as usual.
Mar 14, 20:39 UTC
Identified - Our infra team deployed a fix to our production servers and we are seeing an improvement on build performance and build processing. Unfortunately, we are still seeing queues on the Xcode 10.1 stacks. In the past couple of days our infra team deployed multiple possible solutions to our production system and have also been working on upgrading our machine park along with the underlying storage layer itself. Sadly the previous configuration changes only managed to ease the issue with the build times and queues, but didn't manage to fully solve them. Currently we are working on adding new machines and additional storage to our machine park as well as reworking our whole build load balancing logic to be able to handle the increased load generated by the current traffic.

For more in-depth information on the cause of this issue and the steps we're taking to ensure it won't happen again, please check out our blogpost on this topic: https://blog.bitrise.io/update-mac-infrastructure-queues-march-2019

We are really sorry for the inconvenience caused by this issue, but are doing everything in our power to ensure performance is where it needs to be as soon as possible.
Mar 14, 11:27 UTC
Mar 13, 2019
Resolved - The queues are back to normal and the builds should be starting as usual.
Mar 13, 23:42 UTC
Update - Our infra team deployed a possible fix for the currently ongoing queue issues this morning. Sadly even though we are seeing improvement performance and build queue wise the solution didn't resolve the issues. Currently the team is working on implementing a different approach to resolving the issue.

In the meantime, if your project's configuration also makes it possible, using the Xcode 10.0 stack can also ease the queues affect on your build processes.

We are really sorry for the inconvenience this causes and we are doing our best to resolve the issue as soon as possible!
Mar 13, 13:08 UTC
Investigating - We are experiencing high queues on our Xcode 10.1 stack. Our infra team deployed a possible fix, but it could eliminate the queues. The team is currently looking into other solutions that would resolve the issue.
We are really sorry for the inconvenience caused by this!
Mar 13, 10:23 UTC
Resolved - Due to a Firebase TestLab outage we were experiencing issues running our Device Testing steps.
The step logs during this time would contain the following line:
"Failed to start test: 500, error: {"error":"Internal error"}"

You can find more details on the outage here
https://status.firebase.google.com/incident/Test%20Lab/19006
https://status.cloud.google.com/incident/storage/19002#19002009
Mar 13, 03:00 UTC
Mar 12, 2019
Resolved - The queues are back to normal and the builds should be starting as usual.
Mar 12, 22:59 UTC
Update - Our infra team is currently working on a possible solution to the ongoing queue issues and they are aiming to get it out to production as soon as possible.
Mar 12, 17:32 UTC
Identified - We are experiencing high queues on our Xcode 10.1 stack, our infra team is currently investigating the issue.
We are really sorry for the inconvenience caused by this!
Mar 12, 11:57 UTC
Resolved - The queues are back to normal and the builds should be starting as usual.
Mar 12, 01:00 UTC
Update - Our infra team found an issue with increased machine create and destroy times. This is causing the currently ongoing issue with the high queues. The team is currently working on resolving this issue as soon as possible.
Mar 11, 16:14 UTC
Identified - We are experiencing high queues on our Xcode 10.1 stack, our infra team is currently investigating the issue.
We are really sorry for the inconvenience caused by this!
Mar 11, 09:54 UTC