Microsoft's data-focused approach to Windows Updates requires an update

Martin Brinkmann
Mar 8, 2019
Microsoft, Windows
|
12

Microsoft uses a data-focused approach to determine if updates are ready for wider distribution and it appears that the company is very content with the approach.

Issues of recent updates suggest that Microsoft may need to rethink its strategy when it comes to Windows Updates.

Microsoft started a new series on the official Windows Experience blog some time ago in which company representatives lift the veil in regards to the company's strive for quality.

Microsoft told the public that update quality is better than ever, and that the same is true for the quality of released device drivers.

In "Data, insights and listening to improve the customer experience", information is provided on how Microsoft uses data to determine the quality of updates.

The fundamental question that Microsoft asks for each release is "Is this Windows Update ready for customers?". Updates go through different stages during development:

  1. Automatic and manual testing of updates.
  2. Evaluation of quality based on diagnostic data and feedback from Microsoft engineers.
  3. Distribution to Windows Insiders and further evaluation of updates.
  4. Distribution to the general Windows population.

The metrics that Microsoft gathers and monitors need to be equal to or better than the metrics of the previous update.

By the time we are ready to ship to our customer base, our metrics must be, at a minimum, at or above the quality levels for the previous release, the idea being that every update should make the Windows 10 experience better.

Is the approach sufficient?

Data plays an important role when it comes to the release of updates. Microsoft, and any other company for that matter, may use it to make sure that certain features behave as intended. It is certainly possible to catch bugs by just looking at data but if you look at recent updates, you will notice that things were not as smooth as Microsoft's data focused appraoch suggested.

Microsoft had to pause the Windows 10 version 1809 feature update because it caused a lot of issues. To name just a few:

All of these issues were not detected during tests conducted by Microsoft, by diagnostic data, and by feedback that Microsoft engineers and participants of Microsoft's Insider program provided.

A game performance related bug was not detected in the most recent update for Windows 10 version 1809. Microsoft had to update the support article to add the performance affecting bug to the list of known issues of the update.

The problem

Microsoft engineers and participants of the Insider program may not provide a sufficient sample size to provide data for all major use cases. Gaming might be such a case. It seems unlikely that Microsoft engineers spend a lot of time playing games on their devices. Even if they would, they could never test new versions of Windows on tens of thousands of games that are available for PC. The bulk of Insider participants may not be interested in games as well. Gaming is just one area where Microsoft's approach falls short.

It is certainly unrealistic to expect Microsoft to catch all issues in all updates before release. The sheer number of hardware and software configurations makes that an impossible task.

But major issues, like game performance in popular games, should not hit the general population.

That's one reason why it is a good idea to install updates a while after release and not as early as possible: you never know what is going to happen.

Now You: Let me know what you think about all of this, and how Microsoft could improve update quality.

Summary
Microsoft's data-focused approach to Windows Updates requires an update
Article Name
Microsoft's data-focused approach to Windows Updates requires an update
Description
Is Microsoft's data-focused approach when it comes to evaluation of the quality of Windows updates and releases sufficient?
Author
Publisher
Ghacks Technology News
Logo
Advertisement

Tutorials & Tips


Previous Post: «
Next Post: «

Comments

  1. Some Dude said on March 19, 2023 at 11:42 am
    Reply

    Are these articles AI generated?

    Now the duplicates are more obvious.

    1. boris said on March 19, 2023 at 11:48 pm
      Reply

      This is below AI generated crap. It is copy of Microsoft Help website article without any relevant supporting text. Anyway you can find this information on many pages.

  2. Paul(us) said on March 20, 2023 at 1:32 am
    Reply

    Yes, but why post the exact same article under a different title twice on the same day (19 march 2023), by two different writers?
    1.) Excel Keyboard Shortcuts by Trevor Monteiro.
    2.) 70+ Excel Keyboard Shortcuts for Windows by Priyanka Monteiro

    Why oh why?

    1. Clairvaux said on September 6, 2023 at 11:30 am
      Reply

      Yeah. Tell me more about “Priyanka Monteiro”. I’m dying to know. Indian-Portuguese bot ?

  3. John G. said on August 18, 2023 at 4:36 pm
    Reply

    Probably they will announce that the taskbar will be placed at top, right or left, at your will.

    Special event by they is a special crap for us.

  4. yanta said on August 18, 2023 at 11:59 pm
    Reply

    If it’s Microsoft, don’t buy it.
    Better brands at better prices elsewhere.

  5. John G. said on August 20, 2023 at 4:22 am
    Reply

    All new articles have zero count comments. :S

  6. Anonymous said on September 5, 2023 at 7:48 am
    Reply

    WTF? So, If I add one photo to 5 albums, will it count 5x on my storage?
    It does not make any sense… on google photos, we can add photo to multiple albums, and it does not generate any additional space usage

    I have O365 until end of this year, mostly for onedrive and probably will jump into google one

  7. St Albans Digital Printing Inc said on September 5, 2023 at 11:53 am
    Reply

    Photo storage must be kept free because customers chose gadgets just for photos and photos only.

  8. Anonymous said on September 5, 2023 at 12:47 pm
    Reply

    What a nonsense. Does it mean that albums are de facto folders with copies of our pictures?

    1. GG said on September 6, 2023 at 8:24 am
      Reply

      Sounds exactly like the poor coding Microsoft is known for in non-critical areas i.e. non Windows Core/Office Core.

      I imagine a manager gave an employee the task to create the album feature with hardly any time so they just copied the folder feature with some cosmetic changes.

      And now that they discovered what poor management results in do they go back and do the album feature properly?

      Nope, just charge the customer twice.

      Sounds like a go-getter that needs to be promoted for increasing sales and managing underlings “efficiently”, said the next layer of middle management.

  9. d3x said on September 5, 2023 at 7:33 pm
    Reply

    When will those comments get fixed? Was every editor here replaced by AI and no one even works on this site?

  10. Scroogled said on September 5, 2023 at 10:47 pm
    Reply

    Instead of a software company, Microsoft is now a fraud company.

  11. ard said on September 7, 2023 at 4:59 pm
    Reply

    For me this is proof that Microsoft has a back-door option into all accounts in their cloud.
    quote “…… as the MSA key allowed the hacker group access to virtually any cloud account at Microsoft…..”
    unquote

    so this MSA key which is available to MS officers can give access to all accounts in MS cloud.This is the backdoor that MS has into the cloud accounts. Lucky I never got any relevant files of mine in their (MS) cloud.

  12. Andy Prough said on September 7, 2023 at 6:52 pm
    Reply

    >”Now You: what is your theory?”

    That someone handed an employee a briefcase full of cash and the employee allowed them access to all their accounts and systems.

    Anything that requires 5-10 different coincidences to happen is highly unlikely. Occam’s razor.

  13. TelV said on September 8, 2023 at 12:04 pm
    Reply

    Good reason to never login to your precious machine with a Microsoft a/c a.k.a. as the cloud.

  14. Anonymous said on September 18, 2023 at 1:23 pm
    Reply

    The GAFAM are always very careless about our software automatically sending to them telemetry and crash dumps in our backs. It’s a reminder not to send them anything when it’s possible to opt out, and not to opt in, considering what they may contain. And there is irony in this carelessness biting them back, even if in that case they show that they are much more cautious when it’s their own data that is at stake.

Leave a Reply

Check the box to consent to your data being stored in line with the guidelines set out in our privacy policy

We love comments and welcome thoughtful and civilized discussion. Rudeness and personal attacks will not be tolerated. Please stay on-topic.
Please note that your comment may not appear immediately after you post it.