18:00:03 #startmeeting 18:00:03 Meeting started Thu Sep 3 18:00:03 2020 UTC. The chair is paddatrapper. Information about MeetBot at http://wiki.debian.org/MeetBot. 18:00:03 Useful Commands: #action #agreed #help #info #idea #link #topic. 18:00:06 yay 18:00:20 #topic Roll call 18:00:22 (there's this thing called #chair :P) 18:00:24 o/ 18:00:29 yo yo in da house 18:00:30 \0 18:00:38 Agenda: http://deb.li/oNCD 18:00:54 nattie: yo-yos also work outside in the garden :P 18:01:02 o/ 18:01:04 o/ 18:01:38 #topic DC20 Review 18:02:07 DC20 worked out pretty well, for a start 18:02:07 :) 18:02:21 Feedback pad - https://storm.debian.net/shared/c_q9vqo2cciXrJ-iI7AdI5pzavfF0HwRQqjC3yELotz 18:02:32 Yeah I think it worked out very well 18:02:41 it was nice to be using etherpad for a while 0:-) 18:02:48 * olasd ducks 18:03:01 wait, there's another question on the etherpad! 18:03:02 storm will be faster soon™ 18:03:05 I'm in work meeting, but will keep an eye to see if there's anything where my input is useful 18:03:34 remember how worried everyone was each time I talked about adding OBS to the stack? 18:03:38 times OBS crashed: 0 18:03:59 #topic DC20 Review - recordings status 18:04:02 the vm it was running on was... quite overpowered ;) 18:04:10 overpowered is good. 18:04:21 Do we know where the reviews are currently? Are there more to do? 18:04:38 I gave up trying to answer that question 18:04:49 we've had reports of some talks missing, and of some talks being misnamed 18:04:58 I have no idea what is in what state 18:05:03 #info Some talks missing from archive and some being misnamed 18:05:18 I've seen some reviews happening for the Malayalam track earlier this week 18:05:20 tumbleweed: have you started uploading to YT ? 18:05:26 well I did 18:05:33 but then some things got reencoded 18:05:42 and it was stated that everything was going to get reencoded 18:05:44 oh interesting I thought that usually only happens once they're all finighe 18:05:48 so, shrug? nafc what's going on 18:05:49 finished 18:06:04 highvoltage: normally, we'd try to get videos finished within a day or two of the talk 18:06:10 #info YT uploads pending resolution of current state 18:06:23 Ok, then not much else we can do here but wait for wouter 18:06:31 #topic DC20 Review - Jitsi 18:06:51 Having a seperate room for each talk seemed to work well for the most part 18:07:01 Directors kept forgetting to stop the stream at the end though 18:07:16 having extra jibris (and the 10 minute timeout) helped there 18:07:24 *nod* 18:07:40 the fact that live streaming doesn't end when everyone (who's not jibri) leaves the room is quite counterintuitive 18:07:47 +1 18:08:01 #info extra jibris helped mitigate directors forgetting to stop the stream 18:08:01 I... (hmm should I even mention this now)... 18:08:18 am also looking at potentially replacing jibri with OBS :) 18:08:19 olasd: we should be able to set the timeout to a minute or so from the next Jibri release 18:08:25 paddatrapper: definitely 18:08:34 I mean, definitely we should do that 18:09:14 I would like to look at janus as a potential replacement, with WebRTC -> RTMP streaming application without all the bulk of Chrome 18:09:17 highvoltage: still not convinced that's actually a step forward - don't see jibri itself as being problematic 18:09:25 +1 18:09:29 sorting out authentication for jitsi (and whatever streams it) is quite important too imho 18:09:46 +1 18:09:50 i'm not so sure after all 18:09:58 people will need to share the password 18:10:01 tumbleweed, pollo: I know, I'm hoping you feel different once you see it working 18:10:02 auth wasn't really an issue at dc20 18:10:08 how is it different from a URL? 18:10:20 my main want for the jitsi side is being able to get the real-time stream in it 18:10:25 pollo: URLs are much easier to leak, for one 18:10:29 people are more hesitant pasting passwords into IRC chats 18:10:52 olasd: yeah, wholesale replacement of jitsi with something tailor-made for conferences would be nice 18:11:07 olasd: yeah, that is important (and something using Janus as the backend could do fairly easily, I already have the code to do half of it) 18:11:20 * tumbleweed expected significatly more jitsi URL leaking than actually happened 18:11:26 I assumed quiet bofs would just post the URL in IRC 18:11:27 *nod* 18:12:27 anything more to be added? 18:12:28 paddatrapper: I'm not sure everyone understands how the janus stuff works, (well, I for one don't), do you think you could give us an intro some time? 18:12:46 There is some re-architecting I want to look at for Billowconf, but hopefully that could serve some of these requirements 18:13:28 highvoltage: sure. The TL;DR is that it uses pure WebRTC with HTTP as the side-channel for client-server comms 18:13:44 does it do any video mixing? 18:14:17 no. It is a SFU (selective forwarding unit), so clients receive the feeds they subscribe to 18:14:36 kk no more questions for now 18:15:19 #agreed need to get real-time stream feed into Jitsi 18:15:55 #topic DC20 Review - Voctoweb 18:16:01 I think that comes with a bunch of complexity, but... :P 18:16:09 (I mean, avoiding feedback etc.) 18:16:21 I suspect that's best accomplished by not using jitsi 18:16:25 (you could also share an rtmp stream from a hosted web browser into jitsi. might be 1-2s behind but still ok) 18:16:33 (#undo maybe) 18:16:37 (or hosted vlc) 18:16:38 #undo 18:16:38 Removing item from minutes: 18:16:41 olasd: yeah 18:16:44 can we move on? 18:16:57 highvoltage: still, feedback risk 18:17:03 yeah we can talk more about that topic later 18:17:07 what we did from SotM was a windowed projector from OBS captured into Jitsi 18:17:10 if the point is for the speakers to know when to start speaking 18:17:17 it can't really be playing in jitsi, without getting feedback 18:17:35 the projector only had the recorded talk source available to it, so no feedback 18:17:46 that makes more sense 18:17:56 #topic DC20 Review - Voctoweb 18:17:56 directors gave a countdown 18:17:58 worked well 18:18:17 voctoweb was great, thanks tumbleweed! 18:18:20 I should follow-through on the rename now 18:18:28 and decide how much more time I want to spend on it... :P 18:18:33 +1, voctoweb worked very well 18:18:45 #agreed VoctoWeb worked very well 18:18:51 playback started to get into the territory where it starts to feel easier to just replace voctocore entirely 18:18:57 I am *so* glad we didn't have to VNC and use usual voctomix for this 18:19:12 and it was nice being able to see who else is logged in and who's doing what in the event log 18:19:22 highvoltage: definiteiyl. VNC with SotM was a nightmare 18:19:35 tumbleweed: I wonder how much of it would be reusable with voc2mix 18:20:14 olasd: I haven't seen an overview of what's new in voc2mix 18:20:24 neither 18:20:28 but architecturally ,it doesn't look like things have changed that much 18:20:53 From our experience, I don't think seeking is needed 18:21:07 inter -> interpipe is the big change 18:21:10 With the fallback script we can fix errors 18:21:17 I think there was one time when a video was restarted 18:21:18 did we ever use it? 18:21:25 (the fallback script) 18:21:27 Not that I'm aware of 18:21:30 neither 18:21:32 might be nice to be able to specify a starting position for a video at the play menu 18:21:40 that would be fairly simple 18:21:44 it's the seeking during playback that's hard 18:21:51 (in case it restarted say, at 30m, in this case it was just a minute or so so not a trainsmash) 18:22:13 *nod* 18:22:18 I think allowing seeking provides more opportunity for things to go wrong that actual use 18:22:25 +1 18:22:27 and seeking still seems doable, I just never found my bug 18:22:44 "oops, scroll wheel focus wrong, just seeked through the talk" 18:22:49 lol 18:23:11 I've stopped counting how many times that has happened to me... :p 18:23:36 anything else here? 18:23:42 we haven't talked about audio 18:23:54 the VU meters sucked about as much as I expected :P 18:23:59 *nod* 18:24:02 should you info or todo things like start playback at a certain timestamp? 18:24:13 it may make sense to have a closer look at voctogui's VU meters, and clone them 18:24:32 #info the VU meters were not accurate 18:24:36 audio mixing started kinda rough but the preset scene feature + auto switchover on recording end got rid of most of these issues 18:24:53 I was hoping to get a chance to look at them during the conf, but ran out of time 18:24:58 it's still possible to do entirely auto audio mixing 18:25:02 based on A+B 18:25:37 tumbleweed: I'm sure someone will want to PiP a recording and talk over it at some point :P 18:25:40 #agreed starting a recording from a specific point would be helpful 18:27:06 I don't see anybody leaping up and down saying they want audio that follows video 18:27:16 (although there was some of that before and during the conference) 18:27:43 what does "audio that follows video" mean? as in, they are synced? 18:27:50 the way it is implemented currently gives the director the option to have audio follow video - just use full screen solo 18:27:57 as in, if you are displaying a video source, its audio will be unmuted 18:28:02 (ah nm I'm with you now) 18:28:14 paddatrapper: yeah, but an annoyingly large number of our directors never used that 18:28:24 they'd use A, B, layout buttons instead 18:28:33 and then have to have somebody unmute over their shoulder 18:28:34 is that a training issue or something to fix in Voctoweb? 18:28:44 maybe make it the default and let someone untick it if they want to do something fancy 18:28:47 maybe a bit of both? 18:28:55 the preset scene feature + auto switchover on recording end got rid of most of these issues 18:28:57 any of our historical directors will be used to the A+B buttons 18:29:02 and not used to having to deal with audio 18:29:10 yeah that is true 18:29:39 I was thinking before the conf that I'd do some sort of basic + advanced mode 18:29:43 but never got there 18:29:52 Perhaps focusing on the presets will fix this and if people need something else they use the advanced mode 18:29:56 e.g. you start with fullscreen solo buttons, and if you enable advanced it says "Here be dragons" 18:30:09 yeah imho advanced + sane defaults should be fine 18:30:20 :) 18:30:50 shall we move on? 18:30:50 I'm happy to take a look at that 18:30:54 #agreed default presets and an advanced mode should be fine 18:31:07 paddatrapper: happy to help get you started on that 18:31:07 #topic Playback 18:31:13 #undo 18:31:13 Removing item from minutes: 18:31:23 #topic DC20 Review - Playback 18:31:26 what's this about? playback of prerecorded videos? 18:31:30 got to be consistent :) 18:31:34 :P 18:31:43 move on? 18:31:45 highvoltage: yes, though I think it was covered in the previous topic 18:31:48 indeed 18:31:51 unless we want to talk about ingesting 18:31:57 or audio compression etc. 18:31:59 it was fortunately boring 18:32:18 I think we should prbably add a section for SReview and do it there? 18:32:38 could do 18:32:48 ah, I thought we had one already 18:32:53 although I think sreview wants to drop some of this responsibility (or do things very differently) 18:33:13 Ok, then we can talk about it now 18:33:23 pre-recorded videos were mostly good 18:33:36 review is an issue, but that's a content team action 18:33:40 Normalisation is a very good idea, but we ran into issues with our pipeline's expectations 18:33:56 mainly around audio 18:34:06 (as in, when we got a video with realy bad audio where it was tought to hear what the person said) 18:34:10 highvoltage: I suspect there's a technical aspect to review that we need to take 18:34:22 content were out of their depth on technical requirements for uploaded videos 18:34:33 look at the 8k audio sampling rate videos that got uploaded 18:34:38 I suppose there are some low-tech solutions to this too 18:34:48 did we ever find out what was recording at 8k sample rate? 18:34:52 like uploading the videos to a private peertube channel 18:34:54 olasd: pitivi 18:34:59 wtaf 18:35:03 #info content were out of their depth on technical requirements for uploaded videos 18:35:10 not sure why, but both of those came from people editing in pitivi 18:35:24 we could easily have automated checks on upload 18:35:29 I can't imagine that being a pitivi default!? 18:35:29 it's probable that it came from the first source they dropped in their timeline 18:35:43 Probably 18:35:43 that usually sets up the project parameters 18:36:25 this could be dealt with by doing automated rejections on ingest 18:36:33 rather than just trying to reencode everything 18:36:57 a mix of both would work - reject obviously bad and then reencode 18:36:58 I think the content team reviewers probably also needed a checklist 18:37:10 paddatrapper: yep 18:37:48 I tried to create such a checklist in one of the lead up meetings 18:38:03 #info a mix of automated rejections on ingest and re-encode the successful submissions would help ensure consistency 18:38:05 don't have the logs at hand, but I recall being shot down because the team knew what they were doing 18:38:35 Looking at the result, a checklist would be helpful 18:39:00 and a more explicit review pipeline 18:39:38 and probably more time for review 18:39:42 so many videos came on the last day or two 18:40:02 I don't know if giving people more time will help 18:40:04 I don't think we'll be able to improve /a lot/ on that 18:40:08 :) 18:40:22 yeah, I doubt we can get people to move faster 18:40:40 but it's safe to say we weren't keeping up 18:40:42 well we can close uploads; but even last-minute pre-recordings seemed to work well, in the end 18:40:47 still, we can better equip the content team, and should 18:41:05 I think one confusion here was that it wasn't clear which team's responsibility this was 18:41:09 I think our best bet is a systematic way of reviewing that doesn't requre the review to watch the entire talk and automated rejections 18:41:16 I thought this was speaker assistance 18:41:23 I don't know who was actually doing this (if anybody) 18:41:52 it all happened so quick that there was never a meeting to draw those lines and discuss who does what 18:42:12 I think urbec did some, but not sure what his review consisted of 18:42:43 when we first started discussing DC20 online we thought of it as "mostly a video team thing" 18:43:13 but our usual DebConf teams did get involved, I think we had at least /some/ responsibility to tell people what we expected from them, especially since this was all new and different 18:43:28 #info there was confusion about who should have been reviewing pre-recorded talks 18:43:33 again, I think we did ok with the time we had available and can do better next time 18:43:55 paddatrapper: automated rejection won't get things like very poor mics though 18:44:18 I still think it's a good idea to have someone review the talk manually 18:44:22 maybe we should require an external mic (as in, no laptop mics) 18:44:27 pollo: no, but it will get things like 8k audio or 144p video 18:44:27 pollo: it's step one 18:44:29 how many poor mics were noticed during review, notified, and actually fixed? 18:44:35 paddatrapper: lol 18:44:37 pollo: definitely need manual review too 18:44:41 1, none fixed :) 18:44:45 olasd: right, no time to actually do that 18:45:05 that seems like something to deal with in a speake racceptance email 2 months in advance 18:45:12 go buy a mic now, claim the expense 18:45:19 your talk has been accepted! please enter your address to receive your "proper presenter care package" 18:45:30 nice! 18:45:51 * gwolf lurks 18:46:03 Dear speaker, your last talk sounded so bad that, we decided to send you this mic. Please keep it, it's on the house, really. Now also use it. 18:46:06 Yes, many people still seem to think laptop microphons are decent-quality 18:46:42 in some cases they are 18:46:52 #info speakers need time to correct their talk if there are issues found in review 18:46:58 macbooks aren't terrible (if you're not typing on them) for example 18:47:02 tumbleweed: Odds are not on their side, though 18:47:18 This sounds like something for #-content or #-team maybe? 18:47:19 tumbleweed: macbooks are also not very popular in our demography 18:47:23 yeah 18:47:30 sadly thinkpad sound systems are truly awful 18:47:45 and those are quite popular in our demographic 18:48:02 it appears that we have thoroughly exhausted this topic. 18:48:05 anything else on this topic? 18:48:12 highvoltage: heh yeah 18:48:22 #topic DC20 Review - Loop 18:48:37 I think I can safely say that Loopy Loop was very successful 18:48:41 ok I'll try to be quick on this one (I'll only talk about it for an hour or so) 18:48:47 well done highvoltage 18:48:48 heh 18:48:52 I wrote a blog about it here /mehttps://jonathancarter.org/2020/08/30/the-metamorphosis-of-loopy-loop/ 18:48:55 thanks :) 18:49:03 the loop was great, but it involved a not very sustainable (i.e. crazy) amount of work 18:49:05 it was nice, my only fear would be that it looked like a lot of manual work 18:49:23 and have started working on the next iteration of it. there's a lot of ideas for improvements 18:49:42 it was a lot of manual work. very managable, I wouldn't want to do it like that again. 18:50:08 #info the loop looked great, but was a lot of manual work 18:50:26 towards the end of the DebConf I found that all the scenes and elements, and the sequences in advanced scene switcher is contained in a single .json file in that scene collection 18:50:33 #info highvoltage is gathering ideas for improvements 18:50:34 having the backup loop was convenient 18:50:35 I'd imagine this is somewhat autotomateable 18:50:51 unfortunately, changing the .json file doesn't change it live in OBS 18:51:00 and probably a task that volunteers could help with (editing incoming submissions) 18:51:08 but, the new OBS in testing also comes with a scripting host that supports Python and Lua 18:51:14 \o/ 18:51:17 so I think we should use that one next 18:51:34 OBS also has an API that I haven't tried out yet and will also try from there 18:51:48 would it make sense to have people send their snippets via peertube using a hashtag or something? 18:51:58 to automate the collection a bit 18:52:06 and even failing all of the above, the Advanced Scene Switched let's you control it by writing to arb files, so there's all kinds of ways and avenues available to drive it 18:52:11 olasd: prone to abuse 18:52:24 pollo: I didn't say that we should automatically put everything on the loop 18:52:30 (duh) 18:53:01 olasd: in this case, I postprocessed every video manually, not sure we'd do it again, but using the video as they provided as-is might not always be the solution 18:53:34 I'd also do things like the shoutout cards in OBS rather than encoding them in, which might be nice if we chain 5 shoutouts in a thread 18:53:37 #info OBS has a json config file for a profile, API and scripting host 18:54:08 and I want to add a whole bunch of other types of content to it, like talk promos/announcements (like on https://peertube.debian.social/videos/watch/64a8624e-1e57-4213-ba37-c72015294b36) 18:54:19 and postcards and a whole bunch of other things 18:55:01 (I was actually just joking about talking about it for an hour but it seems like I'm a roll so will stop myself for now, can give more details at another stage) 18:55:09 highvoltage: sure, just feels to me like 1/ having peertube do the basic transcode; 2/ only having to set a start/end time for playback; 3/ automating the cards in obs instead of in the snippet would cut out a bunch of the manual work 18:55:26 (not all of it, but some of it) 18:55:41 yep. 18:56:10 (nothing more on my end 18:56:17 Anything else? 18:56:23 I just want loopy for all events, so I want it sustainable) 18:56:30 +1 18:56:31 ack 18:56:44 wouter said that he'd like it for FOSDEM too 18:56:46 but... 18:56:58 I do think there's a chance here for volunteers 18:57:02 we haven't figured out how to make it for 2 tracks yet so... fosdem /o\ 18:57:08 this seems like it's high-profile enough that people would want to be involved 18:57:09 (way out of my league for this) 18:57:12 and not that high-skilled 18:57:25 +1 18:57:27 just need to be able to cut some video in an editor, boost audio, etc. 18:58:02 #info post-processing loop snippets is possibly a good avenue for volunteers 18:58:08 #topic DC20 Review - Grabber 18:58:15 yeah, could make a kdenlive (and probably some other video editing sofware if there's interest) tutorials that shows the specific stuff used to edit these clips 18:58:48 I would highly recomend pointing new people at Shotcut 18:59:13 so, grabber 18:59:17 everyone hated the VNC 18:59:22 there were some access reliability issues with VNC 18:59:24 but almost every talk used it 18:59:29 but especially highvoltage hated VNC 18:59:33 but once you got in it worked okay 18:59:40 I think? 18:59:40 #info VNC was difficult to use, but grabber was used a lot 18:59:56 seems we missed some training issues there 19:00:03 how to not bring up the firefox menu when it's fullscreen 19:00:12 I found myself explaining that to somebody on sunday 19:00:24 olasd: it worked for me 3 times in a row, and then it didn't 11 times in a row, and then it worked again a few times in a row. I ended up sifting through all my config files and deleteing every possible reference to VNC and I *think* it's better now 19:00:49 I would just reconnect until it worked 19:00:53 and/or kill the vnc server 19:00:56 I couldn't ever make xtigervncviewer work under wayland 19:01:04 it connected, but the display never refreshed 19:01:12 even though I could see my actions in voctoweb 19:01:15 that happened sometimes under X11 19:01:26 yeah, but it happened everytime in xwayland 19:01:27 :D 19:01:28 we may need to develop a remote-control-of-pad thing that we can drive from a browser 19:01:30 maybe half the time 19:01:44 and just avoid VNC completely 19:01:47 perhaps looking into a spice server might be nice for another time where we need remote desktop access? 19:01:55 we tried 19:01:57 it suuuuuucked 19:02:07 paddatrapper: +1 on remote controlling a pad potentially 19:02:12 awh pity 19:02:25 people did use the pad differently to what I expected 19:02:34 I was assuming questions would be asked on IRC 19:02:47 RDP then? (I think xrdp also relies on X at least on the other side, but at least it's efficient) 19:02:48 and the talkmeister would collate & summarise in thepad 19:03:03 highvoltage: I don't think efficiency was the problem 19:03:03 tumbleweed: yeah, people just ended up cutting out the middle-talkmeister 19:03:07 this seemed like a bug 19:03:13 which worked great, actually 19:03:22 yeah just like with the loop, we had no idea how people was actually going to use all this stuff until it happened 19:03:24 and some non-talkmeisters took on that collation & organisation role 19:03:37 #info potentially look into controlling the displayed section of the pad remotely to avoid needing VNC 19:03:50 no matter the stack, it helps when there are people around to pick up the slack 19:03:51 yeah I tried spice, no go 19:03:56 (you know it's true because it rhymes) 19:04:31 anything else on the grabber? 19:04:51 would we have been better off with talkmeisters sharing their own browser window? 19:04:55 (in jitsi) 19:05:05 I guess many wouldn't have had machines capable of it 19:05:08 the grabber was *crisp* 19:05:12 as a speaker I would say -1 19:05:13 I think we'll run into issues with video quality and readability 19:05:18 getting that through jitsi? ew. 19:05:55 OK, let's move on 19:05:56 keeping an eye on everything turned out to be so chaotic that I appreciated having someone who drove the etherpad and helped take care of a bunch of related things 19:06:11 highvoltage: yeah 19:06:20 #topic DC20 Review - Streaming 19:06:27 The RTMP streams worked well 19:06:32 except when they died 19:06:37 the low latency was very helpful 19:06:41 tumbleweed: yes, except then 19:06:44 kicking the nginxes in the mornings helped 19:06:45 they only died for me when people were restarting things afaict 19:07:02 I had some issues, but reconnecting fixed it 19:07:04 what sort of things were people restarting? 19:07:06 also the lower-quality streams didn't seem to die as often as the higher-quality ones 19:07:11 olasd: maybe that needs to be cron'd :) 19:07:26 but, yeah, the rtmp mirrors were very sensitive to (what I suppose were) network glitches between hosts 19:07:48 that seems like something that colud be fixed with monitoring + automated fixing 19:07:53 tumbleweed: I don't think people restarted things much 19:07:55 and yes 19:08:00 olasd: right, that was my point 19:08:07 yeah, I know 19:08:14 there were breakages that I couldn't attribute to any restarting 19:08:14 just driving it further 19:08:15 #info the RTMP streams were very sensitive to network glitches between hosts 19:08:31 I think nginx-rtmp has all the proper knobs to do the monitoring, we just need to Do It™ 19:08:41 #info the issues could potentially be fixed with monitoring and automated fixing 19:08:45 I did notice the rtmp streams lost time the longer I used them. like, initially the slide I saw in OBS would show in my local stream about half a second later, which is really fantastic considering my latency to europe. but after a day or so it crept up to multiple seconds until I restarted the stream 19:08:50 there were also issues where RTMP clients would end up broken 19:08:54 and need restarting 19:09:13 highvoltage: yeah, the client will increase buffering whenever the buffer gets low (at least sensible clients will) 19:09:59 So, on to HLS streams 19:10:07 the main problem of the rtmp stack is that we need people watching it for a while to test things, but it's hard to test things while people are watching the streams 19:10:22 tumbleweed: I'm sorry I said it was broken for multiple years, obviously that was not quite the case 19:10:25 they got some hate, because there were problems 19:10:45 highvoltage: then, the question is did we change something that made them more fragile? 19:10:49 and if so, we should revert it 19:10:58 what are you talking about now? 19:11:01 HLS 19:11:06 it did seem to switch resolutions more often than needed, I wonder if those thresholds are tunable settings 19:11:23 highvoltage: I think that's video.js's heuristics 19:11:35 we definitely used a newer version there 19:11:41 so, new bugs etc 19:11:48 *nod* that should probably be an action 19:11:55 did we know if many people used HLS in a dedicated client? 19:12:05 (and check if there are pressure settings for switching) 19:12:09 pollo: I didn't mine the logs for that 19:12:11 highvoltage: you offering :P 19:12:21 s/:P/? :P 19:12:27 paddatrapper: sure, but I can't commit to a timeline on that 19:12:29 (but the logs will tell us) 19:12:44 if most people use video.js, "HLS bugs" can as well be "video.js" bug 19:12:52 most people would have, yes 19:13:05 I had problems in VLC too but didn't pay enough attention to them or log them down properly 19:13:05 #action highvoltage to investigate HLS/Video.js tunable settings for switching resolutions 19:14:05 anything else? 19:14:27 hls in video players is not the greatest experience 19:14:46 yeah, rtmp does make more sense there 19:14:51 (for instance, mpv will poke all qualities to do its video / audio format detection before playing the first second) 19:15:05 ouch 19:15:18 sounds reasonable enough 19:15:39 except it needs a bunch of segments of each quality to do that 19:15:46 reasonable for watch movies / tv shows... not so much for interactive live streams 19:15:51 ^ that 19:15:52 *watching 19:16:07 we should look at shrinking the fragment length still 19:16:11 maybe that'll help 19:16:19 s/fragment/segment/ 19:16:26 anyway EOT for me 19:16:29 #info shrinking the HLS segment length may help 19:16:38 thx 19:16:44 is there any streaming method that can try to sync up again? 19:16:47 olasd: so, I played wit hthat 19:16:50 notes on the ticket 19:17:05 (as in, if there's a stretch of time delay that it can compensate to slowly catch up again? I guess not) 19:17:40 highvoltage: generally the answer there is not to buffer 19:17:45 or to keep the buffer size small 19:18:10 we could probably do that in a highly configurable web player, at least. 19:18:37 YT live streaming will let you play at 2x, sometimes 19:18:44 video.js is highly configurable; we haven't bothered much yet 19:18:45 (to catch up) 19:18:59 olasd: cool, I'll spend some time on it, probably before the next MDCO 19:19:01 but we don't expose catch-up timelines 19:19:02 (it's basically a video player construction toolkit) 19:19:16 (with somewhat sane defaults) 19:19:41 (and all the craziness that comes from being in the js ecosystem) 19:19:45 time to move on? 19:19:46 #topic DC20 Review - Etherpad 19:20:02 It worked well? 19:20:20 yes, although visaully impaired people said that it had accessibility problems 19:20:25 gwolf: I see you left a comment saying yous hould have been able to view pads without salsa. That was possible with RO URLs 19:20:34 highvoltage: I thought etherpad was supposed to be better than gobby there? 19:20:36 we™ should probably follow up with them and file some bugs upstream 19:20:47 #info etherpad worked well, though it has accessibility problems 19:20:56 tumbleweed: there was no clear UI for that though 19:20:57 tumbleweed: yes, although still has some problems (I didn't have a chance to catch up on the exact problems) 19:21:14 highvoltage: do we have explicit issues that we can raise upstream? 19:21:18 DebConf is total information overload :) 19:21:26 yeah 19:21:31 pollo: on the menu of a pad 19:21:41 etherpads still need to be archived and the archived copy linked in the wafer 19:21:45 yep 19:21:55 Yes, but as a user you got a link and needed to login to see anything 19:21:57 I have the script from VOC, but need to send it on 19:22:00 (mentioning it for meeting completeness, I know you know) 19:22:01 paddatrapper: I suggest that we reach out to the people who had problems and file the issues upstream, at this stage I don't know what the exact issues are 19:22:26 #action paddatrapper to send on the etherpad archive script 19:22:31 highvoltage: yeah 19:22:33 also, the etherpads looked pretty nice with their default colours and a few people commented on that 19:23:11 there's also an item on the pad for improvements that mention default content for the etherpad 19:23:30 which was fully customizeable 19:23:35 " [DONE] Add some hook to switch to the sponsors loop after a talk when a talk ends 19:23:38 Set up standard etherpad template for creating the pads - remove the 'Welcome to Etherpad!' stuff and add relevant sections (talk title, questions, comments, etc)" 19:23:49 (oops pasted an extra line) 19:23:58 yeah always possible, except that we didn't 19:24:03 this is probably useful know we know what people were using the pad for 19:24:08 maybe content team could own that next time 19:24:16 yeah that too 19:24:42 we had a little too much on our plates 19:25:05 having all the etherpads links available in advance from wafer was *great* 19:25:13 #info look getting the content team to draw up etherpad default content 19:25:46 we also needed better moderation tools than we had 19:26:06 my plan was to switch to a salsa group to control access to etherpad. But never did it because we seemed to be surviving 19:26:26 there was a user blocklist, right? 19:26:28 though I think the owner dialog bubbles helped there 19:26:30 (see, I learned!) 19:26:41 :) 19:26:43 olasd: nope 19:26:50 is it possible to block a user while they are writing? 19:26:57 olasd: practice makes perfect 19:27:09 to block users I had to get salsa to ban them (so they couldn't log in again) 19:27:17 and kill their session from etherpad by deleting the session DB row 19:27:26 wow, didn't realise! 19:27:28 #info we needed better moderation tools - salsa group access for example 19:27:42 but we only had to do this once 19:27:44 salsa group access sounds really tedious to set up 19:27:50 the other problematic user stopped when asked 19:27:56 (setting up group membership, I mean) 19:27:58 a group for blocking access would be nice 19:28:01 olasd: yep 19:28:26 but... next time not etherpad, presumably :) 19:28:32 so, whole new sets of problems 19:28:59 what's the alternative to etherpad? 19:29:25 codimd was suggested 19:29:29 if we don't use that then it might not be worth while to go through the excercise of finding accessibility bugs and filing them and rather do that for the next tool 19:30:00 codimd is great, but I think etherpad was sufficient? 19:30:01 does someone want to volunteer to look at alternatives? 19:30:11 it was sufficient 19:30:29 yep 19:30:32 the implementation of etherpad is far from pretty, though 19:30:51 sticking with etherpad has the advantage of working on something we already know and tested 19:32:55 I think if someone wants to look at alternatives, they're welcome to. Until then we stick with Etherpad? 19:33:00 sgtm 19:33:02 +1 19:33:12 #agreed if someone wants to look at alternatives, they're welcome to. Until then we stick with Etherpad 19:33:23 i've been meaning to look at codimd for other reasons but I won't commit for the video team :) 19:33:23 #topic DC20 Review - Audio 19:33:39 this was probably the weakest area of the whole DebConf 19:34:15 #chair highvoltage olasd tumbleweed 19:34:15 Current chairs: highvoltage olasd paddatrapper tumbleweed 19:34:20 (especially bs1770gain during the first morning) 19:34:25 I'll be back in 3 minutes 19:34:48 I'm not sure audio as a standalone topic makes sense 19:34:55 +1 19:35:02 we've had different issues with audio that were totally unrelated to one another 19:35:20 I also think we've covered a sufficient number of audio topics already, and know that we need a new solution for audio normalization 19:35:28 shall we move on? 19:35:32 well, compression could be the answer to a bunch of those issues 19:35:41 e.g. compressing jitsi and recording input 19:36:02 #info compression could be a solution to a lot of audio issues we've had during the conf (jitsi levels, pre-recording levels) 19:36:05 gstreamer has a compression plugin (ladspa-dyson-compress-1403-so-dysoncompress) 19:36:15 ah TIL, nice 19:36:23 so we might need some gstreamer in the stack 19:36:26 not sure if FFMPEG has a built-in compressor 19:36:30 all the stack is gstreamer 19:36:31 we have lots of gstreamer in the stack 19:36:37 ah cool 19:36:40 not quite all 19:36:50 all the core stack is gstreamer ;p 19:36:50 the jitsi -> voctomix isn't gstreamer 19:37:03 ok, that's fair 19:37:03 just about everything else is :) 19:37:20 jitsi does its own audio compression/normalisation thing 19:37:22 #info gstreamer has a compression plugin (ladspa-dyson-compress-1403-so-dysoncompress) 19:37:26 * fil sneaks in and reads backlog 19:37:28 pollo: poorly 19:37:44 yes, but I think we'd need to disable those options 19:37:46 yes, of course ffmpeg has one (-af acompressor) 19:37:51 I see gstreamer has an rgvolume and replaygain plugin too 19:38:00 anyone familiar with that or tried it? 19:38:25 replaygain is just about setting a gain equal to a bit of video metadata 19:38:58 (so you need to analyse the source to know what gain to set, and record that in the metadata) 19:38:59 using an approach like replaygain can work (e.g. tag ingested files with their max level, adjust volume on playback appropriately) 19:39:06 but that only does normalization, not compression 19:39:13 *nod* 19:39:15 so, it assumes that audio was well mixed to begin with 19:39:23 which it wasn't, generally 19:39:24 ah I assumed you could chain these 19:40:10 you can, but they're two different things (normalization = making sure the max level is your target; compression = making sure your level is steady) 19:40:13 I could imagine expossing a compression control in voctogui 19:40:16 s/gui/web/ 19:40:20 using the latter would make the former less relevant 19:40:36 cool 19:40:47 for playback at least 19:40:57 jitsi would probably have to be a hardcoded compressor in the ffmpeg pipe 19:41:01 ack 19:41:13 I suggest that we revisit this later in the interest of time 19:41:14 which would need real-life tuning 19:41:20 yeah 19:41:29 because compressing can do wonky stuff 19:41:40 shall we move on? 19:41:41 #topic DC20 Review - SReview 19:41:42 #agreed we should implement (configurable) compression in voctoweb playback 19:41:49 #undo 19:41:49 Removing item from minutes: 19:41:56 oops 19:41:57 #undo 19:41:57 Removing item from minutes: 19:41:58 if someone will give me read access to a bunch of videos, I'll show off some visualization that lets you look at a 30 min video and have a good guess about audio level quality 19:42:01 #agreed we should implement (configurable) compression in voctoweb playback 19:42:05 #topic DC20 Review - SReview 19:42:05 (previous topic) 19:42:44 it's hard to have a good discussion here without wouter 19:42:46 do we need wouter for this? 19:42:49 ack 19:42:58 I suspect there are some bus-factor questions that don't need him 19:43:22 e.g. is sreview working for us with bus-factor of 1, or do we need to get more people involved / look at other options 19:43:42 I doubt anyone would disagree that more people involved would be better 19:43:47 it's certainly been the stickiest point during this debconf 19:44:05 personally, I don't think the stickyness there is sreview itself 19:44:12 the upload acknowledgement could do with a bit more css/html... and vocabulary 19:44:24 highvoltage: I think he plans to pull that stuff out entirely 19:44:28 ah 19:44:31 also, apparently that exists, it just isn't working as expected 19:44:34 tumbleweed: no, that's true, it's an issue of... knowledge 19:44:44 there are also handover issues 19:44:50 (of the system and how it works, and how to fix it when it doesn't) 19:45:13 e.g. we're all shrugging, not knowing what the state of the videos is, yet 19:45:23 we could be tackling these as a team 19:45:25 but we're not 19:45:54 sounds like we need a collective session with wouter? 19:45:58 to some degree, one learns how the system works in the heat of battle 19:46:03 I know I did :P 19:46:17 I actually admire our collective ability to hotfix *anything* 19:46:35 tumbleweed: I did put a great amount of energy reviewing videos during the conf 19:46:41 and mostly had to do it a second time 19:46:50 :/ 19:46:55 yeah, I started a big round of final review 19:47:00 and then found that they weren't final 19:47:08 so, ... stopped 19:47:22 that is part of the point of that review, to find problems and address them 19:47:47 but it's also demotivating when you don't really know what's going on 19:47:56 +1 19:48:00 that's pretty much my default setting 19:48:30 a lot of stuff has been dealt with on the fly and could have used some documentation through the dc20 issue tracker 19:48:37 so other would know what was going on 19:48:40 others* 19:48:50 so our on the fly communication could be better 19:49:01 might be good to agree on some communication protocals ahead of the next event 19:49:04 this is a more general remark than just sreview; and this is as much my fault as anyone else's 19:49:19 and we should probably write some low-level sreview documentation 19:49:24 i.e. file issues here, make notes in this pad, mention on this channel when you restart this, etc 19:49:26 when the event is spread across 12 timezones it's hard to read the backlog 19:49:49 separate channels could maybe help? 19:50:00 but pads + bugs sound better 19:50:02 from experience, they don't 19:50:09 +1 on pads + bugs 19:50:11 because people never use the right one 19:50:24 Yeah pads and bugs sound better 19:50:26 irc is better for live throwaway stuff that won't matter anymore 5 minutes later 19:50:52 I'm not so sure about pads 19:51:04 I never know which one is the right one 19:51:14 and feel like we are duplicating the issue tracker 19:51:17 exactly why we should agree on them in advance 19:51:21 a pad tracking here's the shit we've hacked up in sreview right now, would have been good 19:51:37 rather than shouting "PLEASE DON'T TOUCH" at each other 19:51:43 :) 19:51:47 maybe a single issue tracker should work 19:51:57 for the entire operation during the conf 19:52:17 to track each incident individually 19:52:37 they were all a little intertwined 19:52:59 pads are nice because they're ultra quick. no forms to submit, you don't have to flesh out all the details yet, it's nice for quick thoughts that can later be fleshed out in decent bug reports 19:53:31 yeah, more of a living document 19:54:04 true 19:54:23 then again, if someone only wants to use the bugs and avoid a pad, I think that's actually fine too, as long as the information ends up logged at either location 19:54:25 my main point is, whatever tool you pick, pick a single location to take these notes 19:54:27 our end result should probably always be an issue in an issue tracker 19:54:36 yeah 19:54:46 but a working document during the incident is helpful 19:54:59 I started one when I started hacking, but it didn't last long :( 19:55:12 we've drifted away from sreview to more general topics I think 19:55:18 yep 19:56:35 (how long is this silence going to last, can I go get some coffee?) 19:56:49 #topic Long Term Video setup for miniconferences 19:57:06 needs hosting 19:57:25 but conceptually I think it is a good idea 19:57:43 yeah 19:57:54 sure 19:58:07 I'm happy to look into hosting options 19:58:13 The pt-br crowd are doing weekly video chats 19:58:19 it'd be great to be able to host them 19:58:32 I'm working on hosting on a few fronts, combination of free and paid for, and even the debian openstack is miraculously moving forward (I might have more info on that this time tomorrow) 19:58:56 highvoltage: ok, then shall we coordinate your efforts and these? 19:59:02 unfortunately our current infra isn't exactly lightweight 19:59:08 mainly the voctomix bit 19:59:10 paddatrapper: yeah let's work together on that 19:59:31 but I could imagine a long running jitsi + jibri -> stream setup 19:59:43 #action paddatrapper and highvoltage to work on hosting for permanent infra hosting for miniconfs, testing, etc 20:00:23 obs also needs decent software accelleration. seems like the cirrus logic driver is used by default in openstack deployments because it needs miniscule amounts of ram to start up (as apposed to 16MB by the other virtual cards) 20:00:58 vfb any better? 20:01:10 and obs crashes on cirrus, presumably either by missing instructions or too little video memory 20:01:17 not sure, maybe worth a try 20:01:51 that's possibly what I was testing on before we got our GPU instance working 20:01:56 but the memory is fuzzy 20:02:00 I noticed that the VPS's at hetzner uses the virtio for video, I intend to check at digitial ocean and vultr too fwiw just so that we have a list 20:02:54 also... uhm... 20:03:50 yeah the excitement about minidebconfs is uncontainable and it seems that there might be a lot of them happening towards the end of the year 20:04:21 we need a strong volunteer base for that to happen 20:04:32 probably a good target to try out some different stuff. and not sure how much we could even have DebConf video team involved for all of that 20:04:55 my thought is that training will be really important and that we'd have to get every team to be more or less basically autonomous 20:05:33 I think We do have another topic for the minidebconfs. Shall we move to that? 20:05:34 (I mean, I don't mind at all being somewhat available to restart something here and ther if it comes to it, but for the day to day volunteering and stuff I think that should be completely self contained) 20:05:42 oh sure 20:05:45 paddatrapper: yes 20:05:52 #topic Upcoming MiniDebConfs 20:05:55 (I missed there was another item) 20:06:14 #info the excitement about minidebconfs is uncontainable and it seems that there might be a lot of them happening towards the end of the year 20:06:19 :P 20:06:26 so far there is "MDCO Gaming edition" 21+22 November 20:06:32 planning doc: http://deb.li/i4Y5M 20:06:37 "MDCO Brasil" 28+29 November 20:06:39 I had to put it in verbatim 20:06:49 MDCO India 5+6 December 20:06:57 which are all in that planning doc 20:07:39 and also a Spanish one probably across regions that there isn't much detail for 20:07:41 so my main concern here is the expectation that core video team members would be available over three subsequent week-ends 20:07:55 I understand that's not what's being asked of us, which is good 20:08:26 it'll need at least some core video team people available, though 20:08:37 we can perhaps try to change dates so that it's more spread out, which risks getting closer into holiday season or closer ot now 20:09:41 maybe we need to poll the core team and find who is keen and available? If there are not enough of us, then look at changing dates? 20:10:04 I'm presumably still not going to be working, so can have energy on weekends. But can't commit to any particular timezone at this point 20:10:07 I've ended up having to look at things on most mornings during this debconf and I'd rather have that not happen again over the course of three weekends, to put it more pluntly 20:10:10 I'm not going to actively watch all the talks that I can't understand but I don't mind being available for all of them to restart things that fail, not sure to what level more than that would be needed 20:10:18 bluntly* 20:10:48 I'm available Saturdays usually, but my Sundays are already spoken for 20:10:53 olasd: I guess if you could even be available for one of those weekends, it would be fine 20:11:54 saturdays are probably also likely to be the most intense as people (as in, new directors) are getting the hang of things 20:12:24 but, we can also use every event as a little bit of a training ground for the next 20:12:28 highvoltage: sure, I'd love for us to be able to be in a state where that's true; but I don't think we can /commit/ to that right now (i.e. I think this is too ambitious) 20:12:53 I see these as 4 almost completely separate communities 20:13:00 I doubt there'll be much volunteer overlap 20:13:28 Training in itself takes a lot of energy 20:13:37 but is useful in the longer term, hopefully 20:14:00 tumbleweed: in DebConf we usually bring the next DC team to the current one, at least the gaming edition is in a language that's mostly common, maybe we could get people from all those teams to do some directing there 20:14:13 highvoltage: that'd be a good goal 20:14:26 we try. But we also fail a lot at actually getting them involved :) 20:14:30 it could even be a requirement. 20:14:47 it was a requirement during this debconf 20:14:50 I would like to reproduce all the solution to be able to setup everything and use you as a "N2" support for us 20:14:51 it worked... sort of 20:15:10 the miniconfs are probably what's responsible for it working 20:15:14 anyway, I've voiced my concerns; I'm happy to work towards getting these teams involved so they're mostly autonomous 20:15:18 (language tracks) 20:15:24 well this debconf was also rough for a lot of the reasons we listed above 20:15:27 but I think getting that done before november is a pipe dream 20:16:01 I think we're comfortable with using a lot of our stack for november (not needing to build new things) 20:16:10 until we get to the sreview bits 20:16:34 it might be a good time to experiment with some small bits but yeah I don't think it's the place for major changes 20:16:49 the biggest issue I see for the miniconfs is the sreview parts 20:16:56 tumbleweed: yeah, as long as not all three weekends start at 10:00 UTC 20:16:58 I don't think there'll be the energy for anything but small bits :) 20:17:03 I admit that's a major hole in the plan 20:17:14 (the sreview part) 20:17:21 (I'm sure the brazil minidc won't start at 10:00 UTC :P) 20:18:03 it would be a good time to experiment with other approaches before sreview's next big conference, if wouter had the energy to do that (no idea) 20:18:24 *nod* needs some follow-up with wouter 20:18:27 :) 20:19:12 olasd, probably 10h but UTC-3 :-) 20:19:35 :) 20:19:50 that's a lot more civilised! 20:20:05 so about 15:00 for a lot of us in this channel. that's about 2 hours after I got up this afternoon. great! 20:20:32 #link http://deb.li/i4Y5M 20:20:49 tumbleweed: FWIW we didn't publicize enough the RO URLs (for getting to the pad without salsa) 20:20:56 I never heard of them, at least 20:20:59 gwolf: we didn't, yeah 20:21:03 (yes, I'm hard of hearing...) 20:21:13 we decided not to bother exposing them in wafer, because too much work 20:21:46 should we #agree on something and move on? 20:22:06 yes, please :) 20:22:09 we agree that all the minidebconfs will be crazy but I think it's going to be ok 20:22:19 what worked to me at MiniDebConf Brussels was watch olasd setup a machine, and after try to reproduce it by myself. And asking to him when I dind't know something 20:22:43 *MiniDebCamp 20:23:34 #agree that minidebconfs need to have their own volunteers 20:23:51 phls: that helps you to understand a little bit about how things are set up 20:24:06 #agree video team will provide training to minidebconf volunteers, and basic infra 20:24:10 but I don't think it teaches you how to troubleshoot the problems that arise during the conference 20:24:27 actual role distribution TBD 20:24:46 tumbleweed, yes, in this case, I believe it will be important work together on MDCO gaming before 20:25:15 any other #agrees needed? 20:25:18 yeah, some training may be possible there 20:25:22 tumbleweed: troubleshooting checklist = reboot the servers one by one until things work 20:25:27 or shall we move on? 20:25:33 let's go 20:25:43 #topic Blog post / some sharing about videostack during this DebConf 20:25:57 I added this entry because I wasn't sure if anyone was working on this 20:25:57 we skipped the hls topic 20:26:08 didn't we cover it enough? 20:26:17 olasd: we dealt with it during Streaming didn't we? 20:26:49 it basically comes down to further research into tunables for the web player and shrinking segments in nginx if possible 20:26:54 I have no idea what that was about 20:26:59 ok then 20:27:24 so pollo has done some blog entries in the past, not sure if he is this time or if we should perhaps work on one collectively somewhere? 20:27:41 I think that there was enough new and exciting things to talk about and that we should share 20:28:09 There were also a few people asking about our setup, so having something to point people to would be nice 20:28:33 Why blog post and not document it properly in sphinx? 20:29:07 sphinx documents don't read that well on planet Debian, but yes the documentation parts should be in spinx 20:29:16 I think for me, we have things documented, but that doesn't highlight what was added to get everything work 20:29:29 and/or we should give a talk about it 20:30:21 do you think nattie has learned enough portuguese yet so that she can present it at the portuguese MDCO? 20:30:33 (I'm 52% joking, of course) 20:31:25 maybe during MDCO#2 Gaming? 20:31:33 yeah a talk or even a lightning talk would be nice, but I like the idea of a blog post. I guess I could just tack on some of it in my next DC20 blog post if there's not particular interest for that 20:31:54 I am happy to take a stab at it too 20:32:29 pollo: also something like "malayalam characters lead to improved internationalization in sreview" is an interesting thing that happened but probably doesn't have much space in the documentation 20:32:51 paddatrapper: shall we do that in an etherpad? 20:33:04 #action paddatrapper and highvoltage to flesh out a blog post 20:33:08 highvoltage: good idea 20:34:57 anything else here? 20:35:05 This meeting has been going for more than 2h30 now and I don't have a brain anymore 20:35:17 ^ this 20:35:20 yeah, lunch time pls 20:35:21 when in doubt move forward :) 20:35:23 #topic Next meeting 20:35:40 Thursday 10 September 2020 @ 18:00 UTC? 20:35:54 do we need to stay weekly? 20:36:01 it's soon but since there are still loose ends for DC20, wfm 20:36:17 should we do a poll to get some new people involved with a new time slot? 20:36:27 yeah, let's do that 20:36:32 or at least... try? 20:36:39 (I know rwalborn was keen) 20:36:43 #action paddatrapper to poll for a new meeting day and time 20:36:48 might be nice to have some more people from India for a few of these 20:36:59 especially approaching MDCO season 20:37:07 #endmeeting