System outage

Comments

108 comments

  • Official comment
    Scott Riesebosch

    Unfortunately what started out as a server update to improve reliability has not gone as planned. We are working on resolving this as quickly as possible. Our team tested the updates on a staging server prior to implementing the updates, but unfortunately something went wrong when implementing the same solution on our production server and it has now taken down all users.

    So sorry about this everyone.

    Comment actions Permalink
  • Greg Buchanan

    For what it is worth, I am in Colorado and I am down. Not sure if location has anything to do with it.

    0
    Comment actions Permalink
  • Eric Shipley

    I have just completed the initial setup and am getting the message “seems garage door is offline”. Would this be due to the system outage?

    0
    Comment actions Permalink
  • Scott B

    @ Eric,
    More than likely yes.
    It is the same error message mine is giving for the last hour or so.

    0
    Comment actions Permalink
  • Eric Shipley

    Thanks Scott. Was worried I did something incorrect installing.

    0
    Comment actions Permalink
  • sam tian

    Now I really hope I have found this page 2.5 hrs ago, so that I don't have to waist my time troubleshoot and write up below email which I just sent out 10 min ago.

    "I received a pop up message on my iPhone says the device is offline.
    I went to garage and see the device is in yellow color.
    I then checked on your website for possible solution, and it says to reset the device.
    I did that, and filled in the password for the Wifi, but it still doesn't work.
    I went one more step ahead, and deleted it from the app, and re-add it in following the instructions. still no luck.
     
    double-checked from the router, that ping the IP address of the controller, it is reachable.
     
    more troubleshooting - removed the tailwind app from my iPhone, and reinstalled it.
    When I try to log in the app with my account(my email address), I got "Hmmm...the network connection seems to be down.
    To isolate the problem from my home network, I disconnect my iPhone's wifi and only use the 4G network, and the same result.
    Next I did was to click on reset my account password, and it gives me the same msg 'network connection seems to be down'.
     
    Now I'm convinced that the issue is your server. it must be down."

     

    0
    Comment actions Permalink
  • Travis Moore

    I'm in Hawaii and my unit is down. Prior to finding this information, I deleted my device from the app and re added it. Still have a yellow light.

    0
    Comment actions Permalink
  • Cain Brewer

    This is just getting silly. Like the 4th outage I've been impacted by lately, what changed? Flawless service up until a couple of months ago!

    5
    Comment actions Permalink
  • Joshua Haigh

    Down in Yorkshire, UK, this does seam to be getting regular.

     

    1
    Comment actions Permalink
  • Philip Lin

    I just used this product for 2 days. I am in Seattle. I can’t login to the app on my iphone now. Very disappointed. The company has our email, an outage notification email should be sent out and provide estimated time for service recovery like power outage. And you told me this is the 4th outage?!

    0
    Comment actions Permalink
  • Frank Marois

    North Carolina. Same issues

    0
    Comment actions Permalink
  • Jeff Walton

    Minnesota. Down for the last 5 hours...

    0
    Comment actions Permalink
  • Wendell Phillips

    Service is down in Mississippi, too.

    0
    Comment actions Permalink
  • Derek

    This is the second time this happened since I purchased Tailwind in October. I’m already contemplating ditching it. Not sure what the problem is, but it doesn’t seem like you guys are addressing the root cause.

    3
    Comment actions Permalink
  • Ken

    Brisbane Australia = down as well

    1
    Comment actions Permalink
  • Michael Teator

    I'd ask if anyone wants to buy my two tailwinds but who wants something that always goes down.

    1
    Comment actions Permalink
  • Steven Tender

    I recently received a new Tailwind setup for two garage doors.  Set everything up yesterday and it was working fine.  I went to show it off for my family and it was not working last night and again today.  Hopefully it will be back up and running soon.  I like that I can close AND open the doors.  I had MyQ before but that system can only close, not open.

    1
    Comment actions Permalink
  • Brewzer

    Two words, "Server redundancy".

    1
    Comment actions Permalink
  • Sam N

    Hi Scott, is there a possibility for some sort of outage failover mode where opening and closing will still work in event of a system outage?

    1
    Comment actions Permalink
  • Egon Rinderer

    One hyphenated word and another word: micro-services architecture. There's a reason commercial cloud service providers (SaaS/PaaS/etc.) are M-SA based...you can roll out changes to containers slowly and only impact a small number of users and immediately roll back if necessary. Spread the services globally. Outages basically become a thing of the past (unless your cloud provider has a major outage). Anyway, retool the back end, throw it in Fargate (or whatever vendor's like-kind service you prefer) and forget about it. Life is SO much easier. I feel for the folks at Tailwind fighting these server based outages. All the focus goes into dragging legacy architecture along as opposed to modernizing. It's the plight of a fast growing small business trying to scale. Anyway, from a customer's perspective, while it sucks to have the service down, I've got traditional openers and some patience for the situation. The service is free, so I am not going to complain (yet). A local API would be really nice, though. 

    4
    Comment actions Permalink
  • Sam N

    My guess is that without a SAAS business model with recurring fees built in, there is no incentive to move to a cloud architecture.

    0
    Comment actions Permalink
  • Chris Griesemer

    System is offline in Texas as well. I haven't had any other outages with my smart home products in the time I've had Tailwind go down three times. Getting a little tired of the unreliability, especially when I have it to make my wife/family's lives easier/more convenient. This only adds more consternation and frustration.

    2
    Comment actions Permalink
  • Neil Alexander

    Two comments:

    1. As Brewzer said "Server Redundancy."

    2. Stuff happens.  When it does, COMMUNICATE!  You should have sent out an email to all users about this problem, not just posted it (belatedly) on the website.

    1
    Comment actions Permalink
  • Steven Tender

    Maybe try to unplug it and plug it back in?

     

     

    0
    Comment actions Permalink
  • Randy Adams

    Scott, in the future can you be more proactive and send an email message letting customers know that you have an issue (server down, power outage, etc.)? This would save me 45 minutes of getting a ladder, doing a reset, reloading the app and other tasks. Just a thought...

    0
    Comment actions Permalink
  • Joseph Fiore

    I have no affiliation with the company... just throwing this out there. It's been down twice (maybe three times) since I've had it (April last year). Do I /want/ it to work perfectly every time? Of course. But, without monthly service fees, I expect a problem now and then. I'll certainly update that opinion if it gets more frequent.

    It stinks when it's rainy, dark, and you've gotten used to just driving up. But, by my calculations, it's worked about 99% of the time I've had it. Everyone has their tolerance for these things but this is within mine.

      --Joe

    5
    Comment actions Permalink
  • Preethum Prithviraj

    The benefits still outweigh the problems given that there's no recurring fee. However, I agree with a few of the comments above: 1) Would really like an e-mail notification when this happens so that I don't spend time troubleshooting my own network first, 2) Would LOVE a locally accessible API to be available as a fallback (for our own coding access and for direct from the app into Tailwind device on the same network)

    4
    Comment actions Permalink
  • Scott Riesebosch

    Hi Everyone, 

    Thanks for your patience. We actually do have our server in the cloud. It's on AWS. I selected AWS because I wanted the highest reliability server. Ironically we were doing an upgrade to the server to increase the reliability when something went very wrong. I am personally quite upset because I put additional resources in place to keep this from happening. There are changes being made to our team. This should never happen to this degree.

    Also, it appears that a number of people are not receiving the notifications that are being sent through the app. We've sent 3 of them. We wanted to use the notifications because they're immediate, but I hear you - we need to send emails as well.

    We are testing local APIs internally already. In the interest of turning something terribly negative into a positive, may I please ask how you would like the local API to work when it comes to shared access? The owner's phone / account would always work, but most people share access either full access or time of day restricted access.

    The one thing we struggle with is a situation like the following:

    You are the owner. You share access with someone else. Then you revoke that access but that user has taken their phone offline from the internet, and your Tailwind device is offline from the internet. This opens up a security risk because that shared user would still have access to your Tailwind controller and open the door until the Tailwind controller is reconnected to the internet and receives the updated permission status for the shared user.

    I'm going to guess that this is an acceptable risk to most users but would like to ask.

    2
    Comment actions Permalink
  • Egon Rinderer

    I hear you, Scott. My point was VMs in the cloud still go down (even with redundancy). Moving to a serverless MSA approach brings reliability levels that simply can't be achieved by a "server in the in the cloud" approach (especially when it comes to rolling out upgrades, etc.). Anyway, not relevant for this thread. Appreciate your hard work to get things back to stable working with your current architecture. 

    As for local API: that level of "how it works" would (in my mind) be left to the whim of the owner. Just expose (with proper auth) the API and let folks create their own tooling around it. If I want to use my RasPi that I use for a dozen other things for integration, sobeit. I wouldn't be looking to you to create the "how it works". Just the interface. Others views may well vary. 

    2
    Comment actions Permalink
  • Derek

    I think it would be beneficial to have more than one level of shared access. One for people who live in the house and will always need access, ie equal access to the owner (partners, children, etc) and then a secondary level for people who you maybe don’t want to have forever access. Then in a downtime situation those users could be treated differently.

    0
    Comment actions Permalink

Please sign in to leave a comment.