I finally put video storage on S3 without the instance going borked.
But when importing a video from YouTube, I’m now getting 「 [Video import to] (https://DOMAIN/my-library/video-imports) https://yewtu.be/watch?v=VIDEOID has failed」 (my instance isn’t in English, so I manually translate it).
8月 06 07:18:16 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:16.078 info: Will create 0 subtitles from youtube import https://yewtu.be/watch?v=VIDEOID.
8月 06 07:18:16 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:16.087 info: 60.152.0.0 - - [05/Aug/2021:22:18:16 +0000] "POST /api/v1/videos/imports/ HTTP/1.0" 200 3148 "https://DOMAIN/videos/upload" "Chrome"
8月 06 07:18:16 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:16.089 info: Processing youtubeDL video import in job 865.
8月 06 07:18:16 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:16.121 info: 60.152.0.0 - - [05/Aug/2021:22:18:16 +0000] "GET /api/v1/videos/81115/captions HTTP/1.0" 200 21 "https://DOMAIN/videos/upload" "Chrome"
8月 06 07:18:16 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:16.137 info: Importing youtubeDL video https://yewtu.be/watch?v=VIDEOID to /mnt/storage/tmp/7ba64972157b612dd17a50d3f0640a107287f3baa8f65e1ff1d0a2475e3f7f72-import
8月 06 07:18:16 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:16.176 info: 60.152.0.0 - - [05/Aug/2021:22:18:16 +0000] "GET /lazy-static/previews/7db7ec4d-c253-4c33-8a83-5d2b7595aaa3.jpg HTTP/1.0" 200 121130 "https://DOMAIN/videos/upload" "Chrome"
...
8月 06 07:18:23 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:23.984 info: Creating job to broadcast delete of video https://DOMAIN/videos/watch/0e7725e6-33f5-4db1-80a6-2401e65855b6.
8月 06 07:18:24 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:24.008 info: Removing files of video https://DOMAIN/videos/watch/0e7725e6-33f5-4db1-80a6-2401e65855b6.
8月 06 07:18:24 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:24.013 info: Processing ActivityPub broadcast in job 16377.
8月 06 07:18:24 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:24.040 info: Removing preview file 7db7ec4d-c253-4c33-8a83-5d2b7595aaa3.jpg.
8月 06 07:18:24 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:24.042 info: Removing miniature file 3be4a507-36ff-40d4-a6c8-96bcd9eb55f2.jpg.
8月 06 07:18:24 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:24.064 error: Cannot execute job 865 in queue video-import. {
8月 06 07:18:24 DOMAIN peertube[32467]: "payload": {
8月 06 07:18:24 DOMAIN peertube[32467]: "type": "youtube-dl",
8月 06 07:18:24 DOMAIN peertube[32467]: "videoImportId": 865,
8月 06 07:18:24 DOMAIN peertube[32467]: "fileExt": ".mp4"
8月 06 07:18:24 DOMAIN peertube[32467]: },
8月 06 07:18:24 DOMAIN peertube[32467]: "err": {
8月 06 07:18:24 DOMAIN peertube[32467]: "stack": "Error: ENOENT: no such file or directory, chmod '/mnt/storage/videos/0e7725e6-33f5-4db1-80a6-2401e65855b6-720.mp4'",
8月 06 07:18:24 DOMAIN peertube[32467]: "message": "ENOENT: no such file or directory, chmod '/mnt/storage/videos/0e7725e6-33f5-4db1-80a6-2401e65855b6-720.mp4'",
8月 06 07:18:24 DOMAIN peertube[32467]: "errno": -2,
8月 06 07:18:24 DOMAIN peertube[32467]: "code": "ENOENT",
8月 06 07:18:24 DOMAIN peertube[32467]: "syscall": "chmod",
8月 06 07:18:24 DOMAIN peertube[32467]: "path": "/mnt/storage/videos/0e7725e6-33f5-4db1-80a6-2401e65855b6-720.mp4"
8月 06 07:18:24 DOMAIN peertube[32467]: }
8月 06 07:18:24 DOMAIN peertube[32467]: }
8月 06 07:18:24 DOMAIN peertube[32467]: [DOMAIN:443] 2021-08-06 07:18:24.083 info: Notifying user admin its video import https://yewtu.be/watch?v=VIDEOID is finished.
When I verify:
$ ls -thal /mnt/storage/videos/0e7725e6-33f5-4db1-80a6-2401e65855b6-720.mp4
-rwxrwxrwx 1 peertube peertube 37M 8月 6 07:18 /mnt/storage/videos/0e7725e6-33f5-4db1-80a6-2401e65855b6-720.mp4
This only happens while mount binding to S3 (using riotfs to connect).
How I mount:
#!/bin/sh
export AWS_ACCESS_KEY_ID="〇〇"
export AWS_SECRET_ACCESS_KEY="〇〇"
export VD_STORAGE=/mnt/storage
export S3_STORAGE=/mnt/s3storage
echo "mount S3 storage"
riofs --uid 1000 --gid 1000 --fmode=0777 --dmode=0777 -o "allow_other" -o "use_path_request_style" videostorage $S3_STORAGE
echo "copy from storage what's not on S3 storage yet"
cp -rvn $VD_STORAGE/videos/* $S3_STORAGE/videos
cp -rvn $VD_STORAGE/streaming-playlists/hls/* $S3_STORAGE/streaming-playlists/hls
echo "mount redundacy"
mount --bind $S3_STORAGE/redundancy $VD_STORAGE/redundancy
echo "mount videos"
mount --bind $S3_STORAGE/videos $VD_STORAGE/videos
echo "mount streaming-playlists"
mount --bind $S3_STORAGE/streaming-playlists $VD_STORAGE/streaming-playlists
Any idea about how or why?