Repository navigation
Meeting Notes 2023
Sam Freund edited this page May 11, 2026
·
1 revision
- 10 days to kickoff!
- Aruco-nano exposed as a toggle switch? And hook in adaptive thresh/other tuning things from normal Aruco
- Download/upload camera calibration coefficients per-resolution would be sweet
- Publish protobuf alongside Packets. Re: Peter - quickbuf is gone?? Replaced with python?? Look into... but quickbuf works fine for now. Duplicate java sources bug actually fixed!
- Chris - status LEDs. More thought on how this works with multi-cam, maybe hardware per camera? Only useful for LL/Glowo/Snakeye. As is, one global set of status LEDs and results are ORed together. Can be aggressive with merging (just double check Jackson is happy with serde)
- NetworkManager (i hate networking): Add user input before going and installing NetworkManager? "I'm gunna go install XYZ, if you don't say yes I won't be able to do Y". Also add disable-networking flag to systemd based on user input in install script? (And a send it flag for headless installs)
- photon-image-modifier -- generates LL/Pi images from known good base. Pretty great. Need to update CI to pull those in instead. Also need to figure out auto-expanding FS
- pose_calib_native -- Probably won't ship this season. RT13's got that standalone thing. Might be worth mainlining and shipping a standalone JAR and shoving in mrcal if we can't get this working.
- Anand's OPi5 guide -- can we copy/paste this into our docs? ours is pretty bare-bones rn
- Calibration visualization/improvements -- cut in config file changes to start saving calibration observations, even if we don't show the data right now.
- How do we wanna deal with multi-tag and tag filtering?
- We can let people upload java code and JIT it but I'm sad
- People tend to wanna filter tags different custom ways pre-combining for multi-tag
- Declan: can probably offer a bunch of options for intra-frame optimization? Longer-term, inter-frame (history of observations)?
- Factor graphs are another thing we can do
- Probably just do the naive thing for now? Add a global filtering/localization tab
- RANSAC (google says Random sample consensus?)
- distance from camera
- high ambiguity
- constrain within field (would need robot pose to be piped in)
- use gyro heading to help reject tags? (but then you need a gyro)
- How should we let people upload field layouts and configure them?
- Select tags that are used
- One time field layout upload in the UI, with a view showing tag poses somehow
- Gib h264
- Gstreamer RTC -- no web
- WebRTC -- No docs, usable in JavaScript. But we need this if we want browser UDP
- Manged to get a webrtc stream working in Python to a browser
- Maybe use a pure Rust/native webRTC implementation and wrap with a JNI
- You have to do your own encoding and then pass it to WebRTC
- h264 over websockets?
- Better to use a real transport like WebRTC over a custom DIY websockets approach
- LibAV can do some degree of cross-platform hardware acceleration, but it's a PITA to write code for
- Libcamera seems to have a way to encode frames? https://github.com/raspberrypi/libcamera-apps/blob/a6267d51949d0602eedf60f3ddf8c6685f652812/apps/libcamera_raw.cpp#L70
- We would probably really want hardware acceleration to run real-time h264 encoding
- Sim refactor PR
- 3044 was pretty happy
- Maybe just merge and document the features?
- Make it a hard transition from the old sim classes
- Yank example from AprilTagWorkbench
- Settings robustness
- Should we just move to SQL?
- Should we export all the files as a db, or a JSON?
- We should export/import JSON ZIPs, and save as SQL DB locally so people still have plain-text
- Camera streaming is super slow on Pi
- High frame divisor to get good performance
- Should we have a switch to totally disable streams per-camera in Photon? Just don't draw on input/output or anything, and streaming is a huge drain on Pi resources
- We should do more profiling on new SBCs (like orange pi) to check on bottlenecks
- Status LED/camera LEDs shouldn't be tied to a single Camera anymore
- Dumb
- We should have a GUI to map physical hardware to cameras
- Frontend Vue refactor PR (we should merge it)
- Proper robotpy support issues are open (836, ownership transfer into monorepo would be cool?)
- GPU accel
- unionfind in GPU!
- someone should mess with orange pi v4l
- Poke FIRST about usage reporting again
- Libcamera shader: oversaturated colors are blown out and wrap around
- Camera calibration rework
- mrcal has a c API, technically
- Desktop app wrapping mrcal python seems easy
- Can find points using whatever you want (for us, that's openCV)
- List of points is all mrcal needs, but it'll annotate snapshots
- Can we wasm mrcal? (Banks: lots of dependencies, fortran, ewww, no; stick with prebuilt python wheel)
- charuco board support?? for real this time??