My instance has stopped transcoding entirely

I started experimenting with remote runners a few days ago. I created a remote runner on the local server as per the docs, using a new dedicated linux user prunner and the systemd implementation.

After prunner had been successfully started and registered with a token, I restarted peertube.service and opened htop. I expected to see the ffmpeg processes running under the user prunner, however they were still running under the user peertube.

Fast forward to today. I take a peak at htop and the server CPU is practically idle. This is despite the existence of dozens of videos with the status « to transcode ». There are no ffmpeg processes running on the server, under any user.

I disabled remote runners in the web admin panel, but still no ffmpeg processes will start, and the server CPU is idle. When I look at local transcoding jobs in the web admin panel, there are none pending, waiting, delayed, nor active. Meanwhile, my users are confused and frustrated that their videos won’t publish.

Why won’t it transcode?

I don’t know why it does not start, but to fix existing video, you can try to go to /admin/videos/list?search=isLocal%3Atrue, and use the « execute HLS transcoding » option (not 100% of the english name of this action).

First try it on one video only, to check if it works.
If not, check the logs to understand.
If it works, you can then do it on remaining videos.

1 « J'aime »

And before doing so, have you checked remote transcoding jobs status? On the /admin/system/runners/jobs-list page.

1 « J'aime »

There are ten thousand jobs there. The remote runner never touched them it seems.

Should I cancel or delete the jobs?

Is the runner listed here: /admin/system/runners/runners-list?
Have you tried restarting the runner service after having restarted peertube?

1 « J'aime »

Yes, the runner is listed. And it says it was last contacted less than a minute ago.

Yes. I enabled remote runners for VOD transcoding in the admin panel. Then I clicked « Update configuration ». Then I ran sudo systemctl restart peertube.service prunner.service. No ffmpeg processes are running.

There are ffmpeg jobs running under prunner now! It might be working.

Maybe it was a race condition because you restarted both services at the same time?

1 « J'aime »