Monday, 10 August 2020

Interview with Sony WH-1000XM4 Engineers

Sony WH-1000XM4 engineer interview

Sony Japan has put up an interview with some of the engineering team responsible for the WH-1000XM4. The interview is in Japanese, but Google translate does a decent job at translating it. You can check out the interview here. I will admit this interview is also a bit like an advertisement for the new headphones, but it does provide some insight into the development.

New Bluetooth chip and NC working together

Sony WH-1000XM4 QN1

Previously in the WH-1000XM3, the QN1 was the main chip responsible for the noise cancellation, but this time around the QN1 works together with the new Bluetooth chip, sensing the noise and music and adjusting the level/degree of noise cancellation up to 700 times/second. An algorithm is used to combine the QN1 and BT chip information which leads to improved noise cancellation. Since this is an algorithm, perhaps future firmware updates could further improve noise cancellation performance.

             

On a side note, while in previous posts I claimed we would be looking at the Mediatek MT2811S in the new WH-1000XM4, this may not be the case. The Bluetooth certification showed AB15abx/MT28abx, so it could be either a Mediatek or Airoha chip. In the FCC teardown photo below, the chip appears more matte than shinny as seen with the MT2811S. Of course the photo is of poor quality, so I cannot make any final judgments here.

Sony WH-1000XM4 Bluetooth chip

In a 52Audio teardown of the WF-XB700, the Bluetooth chip turned out to be an Airoha AB1552, rather than the Mediatek MT2811S. But I will note the WF-XB700 has its own listing in the Bluetooth certification, where as the WH-1000XM4 is grouped with the WI-1000XM2 which is confirmed to be using the MT2811S. We will have to wait for a first teardown to confirm the Bluetooth chip.

DSEE Extreme

WH-1000XM4 DSEE Extreme

Sony describes DSEE Extreme is a further evolution of DSEE HX, which uses AI technology to "reproduce with high accuracy the frequency responses of the original sound source lost during compression". In the interview, the engineers state, that deep neural network technology is used to enhance/upscale the vocals. Normally a deep neural network would require a connection to the cloud, but this is not possible with the WH-1000X4, so it seems an algorithm is used from my understanding. I am guessing this algorithm was developed using AI and then transferred onto the headphones. With DSEE Extreme being an algorithm, perhaps future firmware updates could be used to adjust it or improve its capabilities.

Personally I never turn on the various enhancements on my Walkman, but when I did, I never heard any major difference. The battery life also takes a major hit when using DSEE, so this was another reason I stayed away from DSEE myself. For anyone with the new WH-1000XM4, does turning on DSEE Extreme change/improve the sound quality much? Post below in the comments.

Speak to Chat

The interview provides some details about how it works but the interesting aspect is that it also uses deep neural network AI technology like DSEE Extreme. It uses a special "conversation detection algorithm". The engineers mention that the AI tech for speak to chat will slowly become smarter by learning from the user. Not sure how, perhaps it transfers data to the phone and then via the Sony Headphone app sends it off to some server for algorithm improvements? Personally, I do not expect that, but who knows. Speak to chat uses the feed-forward microphones, and the multi-array of microphones at the bottom.

It seems like the amount of microphones has not changed from this photo, 3 on the bottom of the left cup, the same as in the WH-1000XM3. So it will be interesting to see a teardown and compare the internal components and see the changes, especially to see if there are any additional microphones that were mentioned in the Walmart leak.

Built-in proximity sensor and accelerometer

One major addition to the new WH-1000XM4 is the proximity sensor which can be seen inside the left ear cusp. But in addition to this, there is an accelerometer built into the headphones which also detects the movement of taking on and off the headphones. To prevent accidental operation, the touch panel on the right is disabled as well when taking off the headphones, simple yet clever.

1 gram lighter than their predecessor

The WH-1000XM4 weight in at 254 grams versus 255 grams in the WH-1000XM3, an entire 1 gram lighter. This may not sound like much, but there have been various changes to the structure to strengthen various parts, the addition of the proximity sensor and slightly different materials. Some of the weight saving has taken place in the earpads, which are now slightly lighter than before. Will be interesting to see if the battery size has been reduced to lower the weight. Anyone willing to disassemble their newly acquired WH-1000XM4? :D

               

That is most of the interesting stuff I could gather, if anyone finds any more WH-1000XM4 interviews on other websites, please link them at the bottom in the comments.

6 comments:

  1. The biggest disappointment of the xm4 is the call quality which is still bad (compared to many other headsets out there from Bose, Microsoft and Epos).
    I can't understand how could Sony add another mic to make 5 mics look still useless compared to the Bose nc 700? Did they really try the call quality before releasing the xm4? I read a tech review article where the author claimed that he asked an engineer from the wh1000xm4 team to know if the xm4 was using new mics or the same old mics that the xm3 used. He said that the engineer refused to answer his question which leaves us to wonder how many outdated hardware from the xm3 were recycled in the xm4?

    ReplyDelete
    Replies
    1. There is no 100% confirmation that another microphone was added, still looks like a 3 microphone array at the bottom for calls, which is identical to the XM3, maybe NC might on the outside is used now as well, who knows.

      Do you have a link to that said tech review? would be great to see it.

      here is a comparison of the surface 2 headphones and XM3 mic arrays.

      surface 2
      https://imgur.com/PqjshaT

      close up
      https://imgur.com/e3ndewA

      XM3
      https://imgur.com/7XjSFYa

      close up
      https://imgur.com/K0tLI7M

      I suspect the issue is not new mics vs old mics, because the surface 2 headphone mics look identical to the first surface headphones. But more to do with position of the mics inside the headphones, seems like there is more plastic and the placement in the XM3 is not that great.

      Delete
    2. Adding a second reply, looks like in this teardown of the bose 700

      https://youtu.be/yXe4AEXSmeI?t=272

      Again 3 mics, but they are spread out much more, 2 in the front and one in the back, present on both sides, so a total of 6 mics. It seems Bose uses all of these for NC and also for voice, while Sony has dedicated mics for NC and 3 for voice, this could be the issue why the sony sounds worse.

      Delete
    3. My fault! I misinterpreted his words but here is the exact quote and the link to the article:
      "Sony says it's improved the noise reduction while making calls and also says the upgraded microphones now pick up your voice better. Alas, Sony wouldn't tell me exactly what the microphone differences were between the XM3 and XM4, which seemed odd."

      https://www.cnet.com/news/sony-wh-1000xm4-review-a-nearly-flawless-noise-canceling-headphone/

      Delete
    4. Interesting, well that doesn't surprise me, Sony rarely reveals such things, we will have to wait for a teardown to see if there are any differences. thanks for the link.

      Delete
    5. The gross margin on these headphones must've increased by insane amount, considering the costs of material, battery etc. - all in all it's a very incremental update ... should have been called XM3.1

      The call quality seems to be better, but still sub par to Bose 700. Hopefully, this can be improved by software update ... at least to some degree.

      Delete