iPlayground: CarPlay and MFI Hearing Aids
•
2 likes•930 views
iPlayground: CarPlay and MFI Hearing Aids
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to iPlayground: CarPlay and MFI Hearing Aids
Similar to iPlayground: CarPlay and MFI Hearing Aids (20)
More from Weizhong Yang
More from Weizhong Yang (20)
Recently uploaded
Recently uploaded (20)
iPlayground: CarPlay and MFI Hearing Aids
- 1. Beyond an Audio Player 楊維中 a.k.a zonble iPlayground 2019
- 3. KKBOX iOS macOS tvOS watchOS Uta Pass iOS KKBOX Kids iOS Android KKTIX & KKTIX Manager iOS I’ve been ever working on…
- 5. A Player Needs to Support • Built-in Speaker • Headsets on Headphone Jack • Bluetooth Headsets/Speakers • AirPlay • CarPlay • Other In-Car Systems • MIH Hearing Aids (助聽器)
- 6. CarPlay
- 7. There is only a session about CarPlay Audio, and too much Apple did not tell you.
- 8. Getting Start With CarPlay 1.Get an entitlement 2.Get test devices 3.Get your self into the mine area (踩雷)
- 9. The CarPlay Experience • You can provide only a tree structure to let users to browse your contents • You cannot customize user interface • You can use only the callback block when user want to play an item. There is no way to prompt alerts
- 10. Entitlement
- 11. Entitlement
- 12. Test Device • 你當然也可以在辦公室擺台⾞車車 • 台灣很多汽⾞車車⾳音響公司，提供 ⾞車車⽤用⾳音響改家⽤用的服務，可以 ⾃自⾏行行上網查詢 • 淘寶等電商上，也有在賣⾞車車機 改裝家⽤用套件 • …⽤用改裝家⽤用的 CarPlay 比 Home Pod 更更爽喔
- 13. Test Device • 除了了 CarPlay 以 外，也需要準備⼀一 些其他的⾞車車⽤用⾳音響 裝置測試 • ⼀一般的電腦電源也 可以⽤用，但是要知 道怎樣讓電源線通 電
- 14. Implementing CarPlay • Implement the data source and delegate of MPPlayableContentManager • Set now playing info to MPNowPlayingCenter • Implements commands of MPRemoteCommandCenter
- 15. WWDC 2018 #213
- 16. WWDC 2018 #213 You don’t have to do this at app launch, actually.
- 17. WWDC 2018 #213 But if you do not implement any command, MPPlayerableContenManager does not call your data source and delegate!
- 18. BTW. On Apple TV, MPRemoteController does not work without setting now playing info.
- 19. MPRemoteCommandCenter • Since iOS 7.1 • Not only for CarPlay • But also for controls on iOS lock screen, remote controls on Blue Tooth headsets, other in-car system and so on
- 20. MPRemoteCommandCenter • pauseCommand • playCommand • stopCommand • togglePlayPauseCommand
- 21. MPRemoteCommandCenter • nextTrackCommand • previousTrackCommand • changeShuffleModeCommand • changeRepeatModeCommand
- 24. ❌ The Wrong Way
- 25. ✅ The Right Way
- 26. MPRemoteCommandCenter • changePlaybackPositionCommand • seekBackwardCommand • seekForwardCommand • skipBackwardCommand • skipForwardCommand • Calling skipBackwardCommand and skipForwardCommand may cause seekBackwardCommand also called on the lock screen of iOS 11
- 28. If you are making a player using Core Audio, don’t call AUGraphStop() then AUGraphStart() immediately. AUGraphStart()would fail when connecting to CarPlay
- 29. AudioGraph • Apple’s C API. • Deprecated in 2019. Apple asks us to use AVAudioEngine instead, but, let’s take a look at UIWebView… • AudioGraph manages audio nodes. You shall put the audio nodes into an audio graph, connect the nodes, and then initialize the audio graph • AUGraphStart() and AUGraphStop() are APIs for AudioGraph
- 31. A Core Audio Player Remote IO Node EQ Node Reverb Node Mixer Node Audio Graph Bus 0 Bus 0Bus 0 Bus 0 Bus 1 Render Callback Function Render Callback Function EQ Audio Unit Reverb Audio Unit Bus 1 of Remote IO is for input
- 32. An iOS Streamer Mixer Node Render Callback Function Online Data Decrypt DRM Parse Audio Convert to PCM Audio Converter Service or AVAudioConverter Audio File Stream Service NSURLConnection, URLSession…
- 33. A Core Audio Player on Mac Output Node EQ Node Reverb Node Mixer Node Audio Graph Bus 0 Bus 0Bus 0 Bus 0 Bus 1 Render Callback Function Render Callback Function EQ Audio Unit Reverb Audio Unit Sub Audio Graph
- 34. MFi Heading Aids Since iPhone 5 Compatible hearing devices are listed at https://support.apple.com/en-us/HT201466
- 36. 台灣有哪些 MFi 助聽器？
- 38. Hearing Aids requests Larger Buffer Size
- 39. Player without setting max frames per slice Remote IO Node EQ Node Reverb Node Mixer Node Audio Graph Bus 0 Render Callback Function 1024 1024 1024 1024 1024 1024 1024 1024 👌 👌 👌 👌 👌
- 40. When screen is locked Remote IO Node EQ Node Reverb Node Mixer Node Audio Graph Bus 0 Render Callback Function 1024 1024 1024 1024 1024 1024 1024 4096 ✋ https://developer.apple.com/library/archive/qa/qa1606/_index.html Technical Q&A QA1606: Audio Unit Processing Graph - Ensuring audio playback continues when screen is locked
- 41. When screen is locked Remote IO Node EQ Node Reverb Node Mixer Node Audio Graph Bus 0 Render Callback Function 4096 4096 4096 4096 4096 4096 4096 4096 👌 👌 👌 👌 👌
- 42. When using MFi hearing aids Remote IO Node EQ Node Reverb Node Mixer Node Audio Graph Bus 0 Render Callback Function 4096 4096 4096 4096 4096 4096 4096 5645 ✋ 🤔
- 43. AVAudioSession may also effect buffer size
- 44. 我要感謝⼀一些⼈人 • KKBOX iOS Team，尤其是 Oliver • KKBOX 客服部 • 台灣 Signia • Jedi (jedi.org)