Hello everyone, lately imports from YouTube have begun to behave strangely, perhaps from the blocking in Russia. Have I encountered anyone with this. Nginx 1.27,PeerTube 6.2.1, fffmpeg 6
- When you try to import a video from the link the first time, the import does not go through (the log is empty), just a window opens to fill in the parameters (category selection, etc.)
- From the second time, the import turns out to be successful (tested on several videos), but gives the following errors
- After that, it is recoded and reproduced normally
What could be the reason for this?
warn[16.08.2024, 14:50:36] Cannot process thumbnail https://i.ytimg.com/vi/FJmi_QpRLt8/maxresdefault.jpg from youtube-dl.
{
"err": {
"stack": "RequestError: write EPIPE\n at ClientRequest.<anonymous> (file:///var/www/peertube/versions/peertube-v6.2.1/node_modules/got/dist/source/core/index.js:792:107)\n at Object.onceWrapper (node:events:634:26)\n at ClientRequest.emit (node:events:531:35)\n at TLSSocket.socketErrorListener (node:_http_client:500:9)\n at TLSSocket.emit (node:events:519:28)\n at emitErrorNT (node:internal/streams/destroy:169:8)\n at emitErrorCloseNT (node:internal/streams/destroy:128:3)\n at process.processTicksAndRejections (node:internal/process/task_queues:82:21)\n at WriteWrap.onWriteComplete [as oncomplete] (node:internal/stream_base_commons:95:16)\n at handleWriteReq (node:internal/stream_base_commons:59:21)\n at writeGeneric (node:internal/stream_base_commons:150:15)\n at Socket._writeGeneric (node:net:954:11)\n at Socket._write (node:net:966:8)\n at doWrite (node:internal/streams/writable:596:12)\n at clearBuffer (node:internal/streams/writable:781:7)\n at Writable.uncork (node:internal/streams/writable:529:7)\n at ClientRequest._flushOutput (node:_http_outgoing:1177:10)\n at ClientRequest._flush (node:_http_outgoing:1146:22)",
"message": "write EPIPE"
}
}
error[16.08.2024, 14:55:46] Cannot remove file in youtubeDL error.
{
"innerErr": {
"stack": "Error: Cannot guess path of /var/www/peertube/storage/tmp/1fa343cb7c68e849a4bd88a8f241a0b33b88de8da1f8b7a4cb6ff1feb23c4996-import. Directory content: 1fa343cb7c68e849a4bd88a8f241a0b33b88de8da1f8b7a4cb6ff1feb23c4996-import.f140.m4a, 1fa343cb7c68e849a4bd88a8f241a0b33b88de8da1f8b7a4cb6ff1feb23c4996-import.f247.webm, 29cbccb6450666556a7df1dcb2c40f03fe5b87bbd113962090e91aa35167592e-import.f140.m4a, 29cbccb6450666556a7df1dcb2c40f03fe5b87bbd113962090e91aa35167592e-import.f247.webm, 590-transcoded.mp4, hls, plugins-global.css, resumable-uploads\n at YoutubeDLWrapper.guessVideoPathWithExtension (file:///var/www/peertube/versions/peertube-v6.2.1/dist/core/helpers/youtube-dl/youtube-dl-wrapper.js:107:15)",
"message": "Cannot guess path of /var/www/peertube/storage/tmp/1fa343cb7c68e849a4bd88a8f241a0b33b88de8da1f8b7a4cb6ff1feb23c4996-import. Directory content: 1fa343cb7c68e849a4bd88a8f241a0b33b88de8da1f8b7a4cb6ff1feb23c4996-import.f140.m4a, 1fa343cb7c68e849a4bd88a8f241a0b33b88de8da1f8b7a4cb6ff1feb23c4996-import.f247.webm, 29cbccb6450666556a7df1dcb2c40f03fe5b87bbd113962090e91aa35167592e-import.f140.m4a, 29cbccb6450666556a7df1dcb2c40f03fe5b87bbd113962090e91aa35167592e-import.f247.webm, 590-transcoded.mp4, hls, plugins-global.css, resumable-uploads"
},
"tags": [
"youtube-dl"
]
}
error[16.08.2024, 14:55:46] Cannot execute job 11 in queue video-import.
{
"payload": {
"type": "youtube-dl",
"videoImportId": 585,
"fileExt": ".mkv",
"generateTranscription": true,
"preventException": false
},
"err": {
"stack": "ExecaError: Command failed with exit code 1: /usr/bin/python3 /var/www/peertube/storage/bin/yt-dlp --merge-output-format mp4 -f 'bestvideo[vcodec!*=av01][vcodec!*=vp9.2]+bestaudio/best[vcodec!*=av01][vcodec!*=vp9.2]/bestvideo[ext=mp4]+bestaudio[ext=m4a]/best' -o /var/www/peertube/storage/tmp/1fa343cb7c68e849a4bd88a8f241a0b33b88de8da1f8b7a4cb6ff1feb23c4996-import 'https://youtu.be/FJmi_QpRLt8'\n\nERROR: Postprocessing: file:/var/www/peertube/storage/tmp/1fa343cb7c68e849a4bd88a8f241a0b33b88de8da1f8b7a4cb6ff1feb23c4996-import.f140.m4a: Invalid data found when processing input\n\n[youtube] Extracting URL: https://youtu.be/FJmi_QpRLt8\n[youtube] FJmi_QpRLt8: Downloading webpage\n[youtube] FJmi_QpRLt8: Downloading ios player API JSON\n[youtube] FJmi_QpRLt8: Downloading web creator player API JSON\n[youtube] FJmi_QpRLt8: Downloading m3u8 information\n[youtube] FJmi_QpRLt8: Downloading m3u8 information\n[youtube] FJmi_QpRLt8: Downloading MPD manifest\n[info] FJmi_QpRLt8: Downloading 1 format(s): 247+140\n[dashsegments] Total fragments: 515\n[download] Destination: /var/www/peertube/storage/tmp/1fa343cb7c68e849a4bd88a8f241a0b33b88de8da1f8b7a4cb6ff1feb23c4996-import.f247.webm\n\\r[download] 100.0% of ~ 1.00KiB at 948.25B/s ETA Unknown (frag 0/515)\\r[download] 0.6% of ~ 515.00KiB at 948.25B/s ETA Unknown (frag 0/515)\\r[download] 0.5% of ~ 1.51MiB at 948.25B/s ETA Unknown (frag 0/515)\\r[download] 0.4% of ~ 3.52MiB at 948.25B/s ETA Unknown (frag 0/515)\\r[download] 0.4% of ~ 7.54MiB at 948.25B/s ETA Unknown (frag 0/515)\\r[download] 0.4% of ~ 15.59MiB at 948.25B/s ETA Unknown (frag 0/515)\\r[download] 0.2% of ~ 31.68MiB at 61.07KiB/s ETA Unknown (frag 0/515)\\r[download] 0.1% of ~ 76.95MiB at 61.07KiB/s ETA Unknown (frag 1/515)\\r[download] 0.4% of ~ 19.24MiB at 75.03KiB/s ETA Unknown (frag 1/515)\\r[download] 0.4% of ~ 19.49MiB at 75.03KiB/s ETA Unknown (frag 1/515)\\r[download] 0.4% of ~ 19.99MiB at 75.03KiB/s ETA Unknown (frag 1/515)\\r[download] 0.4% of ~ 21.00MiB at 75.03KiB/s ETA Unknown (frag 1/515)\\r[download] 0.5% of ~ 23.01MiB at 75.03KiB/s ETA Unknown (frag 1/515)\\r[download] 0.5% of ~ 27.03MiB at 75.03KiB/s ETA Unknown (frag 1/515)\\r[download] 0.6% of ~ 35.08MiB at 126.63KiB/s ETA Unknown (frag 1/515)\\r[download] 0.4% of ~ 51.17MiB at
.............................
340/515)\r[download] 66.2% of ~ 71.93MiB at 336.52KiB/s ETA 01:16 (frag 201.61KiB/s ETA 00:01 (frag 514/515)\r[download] 100.0% of ~ 20.86MiB at 201.61KiB/s ETA 00:01 (frag 514/515)\r[download] 100.0% of ~ 20.87MiB at 201.61KiB/s ETA 00:01 (frag 514/515)\r[download] 99.8% of ~ 20.92MiB at 201.61KiB/s ETA 00:01 (frag 515/515)\r[download] 100% of 20.87MiB in 00:01:20 at 264.75KiB/s \n[Merger] Merging formats into \"/var/www/peertube/storage/tmp/1fa343cb7c68e849a4bd88a8f241a0b33b88de8da1f8b7a4cb6ff1feb23c4996-import.mp4\"",
"ERROR: Postprocessing: file:/var/www/peertube/storage/tmp/1fa343cb7c68e849a4bd88a8f241a0b33b88de8da1f8b7a4cb6ff1feb23c4996-import.f140.m4a: Invalid data found when processing input"
],
"ipcOutput": [],
"pipedFrom": []
}
}
Part Nginx log
1.1.1.1 - - [16/Aug/2024:11:54:09 +0000] "GET /api/v1/users/me/videos/imports?start=0&count=10&sort=createdAt HTTP/3.0" 200 52153 "https://angeltales.angellive.ru/my-library/video-imports" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:34 +0000] "GET /api/v1/users/me/notifications?start=0&count=10&sort=-createdAt HTTP/3.0" 304 0 "https://angeltales.angellive.ru/my-library/video-imports" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:38 +0000] "POST /api/v1/users/me/notifications/read-all HTTP/3.0" 204 0 "https://angeltales.angellive.ru/my-library/video-imports" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:38 +0000] "POST /api/v1/users/me/notifications/read-all HTTP/3.0" 204 0 "https://angeltales.angellive.ru/my-library/video-imports" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:54 +0000] "GET /client/ru-RU/chunk-HHCHNV7X.js HTTP/3.0" 200 124687 "https://angeltales.angellive.ru/client/ru-RU/main-Z6GMDOVJ.js" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:54 +0000] "GET /client/ru-RU/chunk-QLQ2CX2U.js HTTP/3.0" 200 2952 "https://angeltales.angellive.ru/client/ru-RU/chunk-HHCHNV7X.js" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:54 +0000] "GET /client/ru-RU/chunk-4YLRC3AG.js HTTP/3.0" 200 1036 "https://angeltales.angellive.ru/client/ru-RU/chunk-HHCHNV7X.js" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:54 +0000] "GET /client/ru-RU/chunk-SWYIAXEH.js HTTP/3.0" 200 6647 "https://angeltales.angellive.ru/client/ru-RU/chunk-HHCHNV7X.js" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:54 +0000] "GET /client/ru-RU/chunk-HKL4Z2FV.js HTTP/3.0" 200 1047 "https://angeltales.angellive.ru/client/ru-RU/chunk-HHCHNV7X.js" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:54 +0000] "GET /client/ru-RU/chunk-7LXHCTHH.js HTTP/3.0" 200 23866 "https://angeltales.angellive.ru/client/ru-RU/chunk-HHCHNV7X.js" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:54 +0000] "GET /client/ru-RU/chunk-LXWZXNRH.js HTTP/3.0" 200 744 "https://angeltales.angellive.ru/client/ru-RU/chunk-HHCHNV7X.js" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:54 +0000] "GET /client/ru-RU/chunk-SP7L3IFL.js HTTP/3.0" 200 3277 "https://angeltales.angellive.ru/client/ru-RU/chunk-HHCHNV7X.js" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:54 +0000] "GET /api/v1/users/?start=0&count=10&sort=createdAt HTTP/3.0" 200 10564 "https://angeltales.angellive.ru/admin/users/list" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:54 +0000] "GET /api/v1/blocklist/status?accounts=root@angeltales.angellive.ru&accounts=angellive@angeltales.angellive.ru&accounts=natali@angeltales.angellive.ru&accounts=raisabulkina2035@angeltales.angellive.ru&accounts=katushka2035@angeltales.angellive.ru&accounts=nina2035@angeltales.angellive.ru HTTP/3.0" 200 530 "https://angeltales.angellive.ru/admin/users/list" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:54:58 +0000] "GET /api/v1/videos?sort=-publishedAt&nsfw=both&start=0&count=10&isLocal=true&include=111&privacyOneOf=1&privacyOneOf=4&privacyOneOf=3&privacyOneOf=2&privacyOneOf=5 HTTP/3.0" 200 81273 "https://angeltales.angellive.ru/admin/videos/list?search=isLocal:true" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:55:17 +0000] "GET /api/v1/users/?start=0&count=10&sort=createdAt HTTP/3.0" 304 0 "https://angeltales.angellive.ru/admin/users/list" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:55:17 +0000] "GET /api/v1/blocklist/status?accounts=root@angeltales.angellive.ru&accounts=angellive@angeltales.angellive.ru&accounts=natali@angeltales.angellive.ru&accounts=raisabulkina2035@angeltales.angellive.ru&accounts=katushka2035@angeltales.angellive.ru&accounts=nina2035@angeltales.angellive.ru HTTP/3.0" 304 0 "https://angeltales.angellive.ru/admin/users/list" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:55:37 +0000] "GET /api/v1/videos?sort=-publishedAt&nsfw=both&start=0&count=10&isLocal=true&include=111&privacyOneOf=1&privacyOneOf=4&privacyOneOf=3&privacyOneOf=2&privacyOneOf=5 HTTP/3.0" 304 0 "https://angeltales.angellive.ru/admin/videos/list?search=isLocal:true" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:55:47 +0000] "POST /api/v1/videos/5a8311c3-d528-46ff-9885-be2cc06069bc/transcoding HTTP/3.0" 409 262 "https://angeltales.angellive.ru/admin/videos/list?search=isLocal:true" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:55:49 +0000] "POST /api/v1/videos/5a8311c3-d528-46ff-9885-be2cc06069bc/transcoding HTTP/3.0" 204 0 "https://angeltales.angellive.ru/admin/videos/list?search=isLocal:true" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:55:49 +0000] "GET /api/v1/videos?sort=-publishedAt&nsfw=both&start=0&count=10&isLocal=true&include=111&privacyOneOf=1&privacyOneOf=4&privacyOneOf=3&privacyOneOf=2&privacyOneOf=5 HTTP/3.0" 304 0 "https://angeltales.angellive.ru/admin/videos/list?search=isLocal:true" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:57:21 +0000] "GET /api/v1/users/me/notifications?start=0&count=10&sort=-createdAt HTTP/3.0" 200 6123 "https://angeltales.angellive.ru/admin/videos/list?search=isLocal:true" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:57:25 +0000] "POST /api/v1/users/me/notifications/read-all HTTP/3.0" 204 0 "https://angeltales.angellive.ru/admin/videos/list?search=isLocal:true" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:57:25 +0000] "POST /api/v1/users/me/notifications/read-all HTTP/3.0" 204 0 "https://angeltales.angellive.ru/admin/videos/list?search=isLocal:true" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:57:25 +0000] "POST /api/v1/users/me/notifications/read-all HTTP/3.0" 204 0 "https://angeltales.angellive.ru/admin/videos/list?search=isLocal:true" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:57:33 +0000] "GET /admin/videos/list?search=isLocal:true HTTP/3.0" 200 6875 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
1.1.1.1 - - [16/Aug/2024:11:57:33 +0000] "GET /socket.io/?accessToken=6f91409cd0bdf7340a5827fec29c290387ec6d1a&EIO=4&transport=websocket&sid=Qqb_uhvu7lq3XluiAABY HTTP/1.1" 101 1087 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"