[Question] Build url #230
Comments
|
I have not yet looked into this but from my limited understanding, it is necessary to parse the MPEG-DASH manifest to create a playback URL suitable for your player. However, some players (ffmpeg) should be able to play directly. Have you tried a different player? https://stackoverflow.com/questions/47056177/how-to-play-mpeg-dash-audio-streams-from-console |
|
No I only tried MPD and VLC, but I will try it asap. |
|
I did just have success with this simple example, using the tidalapi.Stream as the input and then getting the URLs from the manifest. try:
manifest = json.loads(base64.b64decode(stream.manifest))
except json.decoder.JSONDecodeError:
#return f'data:application/dash+xml;charset=utf-8;base64,{stream.manifest}'
return base64.b64decode(stream.manifest).decode('utf-8')
return manifest["urls"][0]However, only one URL is returned and it's quality is not HI_RES so not sure whats causing that. EDIT: The above returned a single URL simply because my loaded session was not a PKCE session after all. Added some more details. My previous example worked simply because the manifest did not contain any dash+xml (i.e. the mpd file) media. So the above example should handle both cases. Parsing the manifest with python mpegdash also appears to work as expected. |
|
Hello, thank you again, but it seems to me that s.manifest once b64decoded is xml, not json, am I doing something wrong? |
|
The output should be an MPD string with an XML declaration header? That is what I got. |
|
Hello, this is the code I am trying. It is derived from the simple pkce login file. |
|
Of course I have the json file with the credentials, so the login_session_file has success |
|
Sorry, I edited my earlier example a while back. You should change your get_url function to be the following def get_url(stream):
try:
manifest = json.loads(base64.b64decode(stream.manifest))
except json.decoder.JSONDecodeError:
return base64.b64decode(stream.manifest).decode('utf-8')
return manifest["urls"][0]FYI, I am already working on extending the Stream class with this functionality and adding MPEG-DASH parsing. |
|
Hello, thank you very much, this code works. |
|
You should be able to feed music player daemon the manifest file for MPEG DASH streaming, i.e. the MPD XML, if your player supports it. Have you tried saving it as an mpd file? This should also work if your ffmpeg installation has been built with the correct support: If MPD expects a stream, you need to parse it further, eg to HLS format so it can be passed as an m3u8 file stream to your player. I got the HLS parsing working yesterday, based on some code snippets online, but it looks like there is a python library that can take care of it as well: |
|
Hello, I will try saving the mpd to a file and play it, anyway Music Player Daemon expects a stream, I cannot assume it to be on the same host as the upmpdcli instance or that it can anyway access the file |
|
Hello, I have successfully played the saved mpd file with ffmpeg, which is good! However I couldn't generate the stream using the library. It fails when I load the xml manifest. Do you have a snippet of this conversion? |
|
@GioF71 Good to hear you had success. Sorry, I have not had time to look at it yet due to work. But I will try to get my conversion code added on a separate tidalapi branch so you can test with it. |
|
Hello @tehkillerbee thank you. The success is partial but it seems to be showing that it might be possible to stream hires also. |
|
Yes, what I have now is a M3U8 File for the HLS Stream. It can be loaded fine using ffmpeg (mp4 container with flac) and the bitrate is indeed 192khz. I would assume this HLS media playlist should work for you. Ill clean up my code asap and get you a branch you can try to test with. I still need to figure out how to integrate all this with Mopidy :) |
|
Hello, thank you for sharing your progress. I look forward to enable the tidal plugin for upmpdcli to work with hires files! |
|
@GioF71 I have added my latest changes in this branch. This is still a work in progress but I think that is enough to get you started: python-tidal For mopidy-tidal, I decided to create a local HLS m3u8 playlist (file://xx) and pass it to mopidy instead of the file URL. Everything works as expected so far when testing. Ofc. it requires the correct GStreamer plugins, i.e. Of course there is still the challenge of generating the pkce enabled login file, without copying it in manually as I have done now. |
|
Hello, thank you. I tried the pkce_login.py, but the resulting files are all empty. Am I doing something wrong? |
|
@GioF71 Same album as in the example? I will check it later today and get back to you. I did some last minute changes that perhaps broke the example code... |
|
Hello, yes, I did not change anything other than the path of my credentials file! |
|
@GioF71 Looks like the token refresh code was broken (I did get the same issue when the pkce session was somehow not valid anymore and I got a non MPEG-DASH stream). So this is the reason you get no playlist - there is no MPEG-DASH MPD available. I have fixed this on the before mentioned branch. Maybe you'll need to login again to make sure the correct access token is used. |
|
ok I have tried again, now the playlist are generated. MPD: ffplay: |
|
If I try the playlist with ffplay, I get: How do you play those playlists? |
|
tried to install but there is no difference :-( |
|
HA, I added |
|
set ffplay to play with alsa and it plays @192 kHz, that's really good progress. No clue how to convince mpd to play though |
|
Yep, that must be added as well for that error to go away. Yep 192kHz/24bit playback works for me. |
|
For playback to mpd, the author of upmpdcli told me I had to pass the url of the "MPD" (not music player daemon). Infact that played in ffmpeg. Is there a way to get that as a URL from your library? |
|
Problem is you do not get an actual URL in the response from Tidal. In the response (json), you get a manifest that must be decoded to get you the MPD (MPEG-DASH) XML. From that, the HLS media playlist can be constructed for playback. Some players can process this string directly, it seems. But I assume MPD (the daemon) can work with playlists too? So perhaps you can just generate a local playlist and pass that instead? That is what I did with mopidy and that worked just fine. |
|
The problem is that I cannot write anything to mpd from upmpdcli (as a media server). |
|
Anyway mpd does not decode the individual URLs anyway, so at the moment this is the first hurdle |
|
When I use BubbleUPnP own "Local and Cloud" with Tidal, the resulting URL for mpd is a plain flac. These is some processing on the BubbleUPnP app and/or BubbleUPnP server, that makes this possible. And of course the mpd+upmpdcli (renderer) stack in this case plays the track without any issue. It just 'sees' a regular flac over http. |
I assume BubbleUPnP only works for lower qualities - not HiRes? The tidalapi plugin can already give you a direct flac URL for playback, but only for <HiRes. For HiRes, only MPEG-DASH stream is available. If you try calling .get_url() when configured for HiRes playback, you will not get any URL. But when using low/high/lossless, you will get MP4 or FLAC (non HiRes of course). |
It works for hires since november of last year, see here
An alternative options come to my mind, I could leverage those urls, cache joined files, and serve them, that should work, what do you think? |
I would expect this requires buffering before playback can be started so maybe that's not ideal. But I don't see why not. I think that is the same way it's done with some of the tidal downloader tools so perhaps you could take a look at them. Or perhaps look at gapless upnp? https://forum.wiimhome.com/threads/gapless-mode-setnexturi-issues-for-upnp-interface.478/ |
|
MPD already tries to acquire the next song to play in advance, iirc 20 seconds. So it can play gaplessly. |
|
What I mean is you already have a list of URLs for each track so perhaps they could be queued for (gapless) playback. Then you avoid buffering the whole track. Out of curiosity, how does MPD/upmpdcli deal with live radio m3u8 (HLS) playlists with multiple segments? Surely they can be played back with MPD without any issues? It is the same principle here used by the playlist presented from tidalapi. It consists of segments, not individual tracks, so it should be handled as such by MPD (daemon), exactly as when playing back a radio stream. I am surprised if this is not possible to do with MPD, perhaps ask the developer for advice? |
|
Hello, I have tried 'serving' the m3u8 file via http, and VLC plays the whole track without a problem. MPD has a playlist plugin here but m3u8 does not seem to be among the supported formats. Maybe that could be the issue, because if I try to add the first url in VLC, it doesn't work as well. |
|
Sorry I was wrong, the m3u8 files work perfectly. I was using Cantata to add the playlist, but it was probably doing something instead of feeding the m3u8 directly to mpd. I tried with mpc and it worked! |
|
Hello, looks like the latest version on the branch you prepared fails with this error: I am using the version from a few commits before (c03864a, says "Added link to documentation" in the message, and this works. BTW I currently have one dev version of upmpdcli which works perfectly. I am not providing metadata like sample rate and bitrate, but it plays just fine. Also it works on Logitech Media Server |
|
Yes it's definitely possibile... I double checked but I must have done something wrong. |
|
I confirm I was using a previous version in my python environment, this is solved now, thank you again |
|
Another thing, the upmpdcli author asks me if we can try and save (then serve) the mpd file instead of the m3u8 files, does it sound possible to you? Thank you again! |
|
@GioF71 Sure, it's already possible. stream = track.get_stream()
manifest = stream.get_stream_manifest()
data = manifest.get_manifest_data()
with open("{}_{}.mpd".format(album_id, track.id), "w") as my_file:
my_file.write(data)But I will probably move the get_stream_manifest function into the Stream class instead since that makes more sense. So eventually, this would be a way to get the mpd file: stream = track.get_stream()
data = stream.get_manifest_data()
with open("{}_{}.mpd".format(album_id, track.id), "w") as my_file:
my_file.write(data) |
|
Hello, thank you. I tried serving the mpd file instead of hls, and mpd (the player) works much better, allowing to seek the track, which did not work when using hls. I also see the bitdepth, sample rate and even bitrate (this is probably calculated by mpd because I did not provide it yet). On the other hand, now Logitech Media Server refuses to play the stream. I can't find any log there. I see on the gui that the type is "application/octet-stream". |
|
Good to hear. Yes I switched to using the mpd manifest directly, gstreamer doesn't mind and it works well in mopidy-tidal. Regarding logitech media server, I am not sure. A possible explanation could be that the mimetype is not dash+xml for that album, resulting in you passing on a non mpd manifest to LMS. I added an extra check to mopidy-tidal to avoid that problem, in case the user is using oauth authentication. What type of authentication are you using? Pkce? |
|
Yes, PKCE of course. With oauth2, LMS works. |
|
@GioF71 Odd. Since it works with oauth2, it must be related to the MPD manifest. Have you tried stripping the XML header before passing on the manifest? |
|
I thought it was related to the ability to play a mpeg-dash stream... but I didn't try to strip xml header. But do you mean to remove just the following part?
|
|
It could very well be that is the issue, as I do not think all players support MPD manifests. But that doesn't explain where Yes, you could try removing it as a test, although I am not sure it will have any effect. |
|
Hello, I didn't try with the stripped xml header yet... Instead I have been busy updating the upmpdcli plugin for hires support. A few things are missing before creating a release:
However it is working quite well for me since a few days now, I am looking forward to hear if anybody else wants to try this. Thank you again @tehkillerbee for your great work! |
|
@GioF71 Sounds great. Good to hear you have made progress so far.
How did you handle PKCE login? |
|
About question one: the plugin receives a request for the url of the next track a few seconds before it actually gets played. To that request I must answer with a mimetype and a url which can offer the mpd file, so I need to temporarily store the file. No caching, it's just a two-step process. About pkce login, I have prepared python file which shows the challenge message, and, if successful, will displays a generated json file as well as a set of env variables for the container. In the second case, the json file is created anyway and subsequently used. The repo I have linked should make things even easier. The get-credential script will automatically place the file in the correct location, by running a docker run command using a mountpoint to the same directory that is used by the docker-compose file. Now the challenge for me is to document the process so it can be easily understandable. |
|
About the file storing: I need to save the file because the http server is not controlled by the plugin, so I cannot create the file in real time. |
|
Hello again, can you confirm that getting the stream information (bit_depth, sample_rate etc) are requests that hit the playwall api? I get http 429 errors if I try to get these metadata too frequently. Or am I doing something wrong? Thank you |
|
See my answer here: #233 as this is not really related to this issue. |
|
Closing this issue now, as I think we got all the issues sorted. Feel free to reopen if necessary. |
Hello, I am upgrading the Tidal plugin for upmpdcli to the latest version 0.7.4 of your library.
Authentication mostly works, the navigation works perfectly just like with oauth2, but playback to the renderer fails.
My renderer is another instance of upmpdcli with mpd of course.
I don't know if this is related to this issue of yours.
What I am currently doing is trying to decode the mpd (not MusicPD this time) manifest, and I get a list of url. But none of those actually play, neither in MPD or in any other player I tried, including VLC.
AFAIK MPD should be able to play MPEG-DASH (see here) so I am probably doing something wrong.
Do you have any suggestion for this issue?
Thank you
The text was updated successfully, but these errors were encountered: