Skip to content

Meeting Notes 2023

Sam Freund edited this page May 11, 2026 · 1 revision

Dec 27, 2023

  • 10 days to kickoff!
  • Aruco-nano exposed as a toggle switch? And hook in adaptive thresh/other tuning things from normal Aruco
  • Download/upload camera calibration coefficients per-resolution would be sweet
  • Publish protobuf alongside Packets. Re: Peter - quickbuf is gone?? Replaced with python?? Look into... but quickbuf works fine for now. Duplicate java sources bug actually fixed!
  • Chris - status LEDs. More thought on how this works with multi-cam, maybe hardware per camera? Only useful for LL/Glowo/Snakeye. As is, one global set of status LEDs and results are ORed together. Can be aggressive with merging (just double check Jackson is happy with serde)
  • NetworkManager (i hate networking): Add user input before going and installing NetworkManager? "I'm gunna go install XYZ, if you don't say yes I won't be able to do Y". Also add disable-networking flag to systemd based on user input in install script? (And a send it flag for headless installs)
  • photon-image-modifier -- generates LL/Pi images from known good base. Pretty great. Need to update CI to pull those in instead. Also need to figure out auto-expanding FS
  • pose_calib_native -- Probably won't ship this season. RT13's got that standalone thing. Might be worth mainlining and shipping a standalone JAR and shoving in mrcal if we can't get this working.
  • Anand's OPi5 guide -- can we copy/paste this into our docs? ours is pretty bare-bones rn
  • Calibration visualization/improvements -- cut in config file changes to start saving calibration observations, even if we don't show the data right now.

May 29, 2023 at 6:00 PM PT

  • How do we wanna deal with multi-tag and tag filtering?
    • We can let people upload java code and JIT it but I'm sad
    • People tend to wanna filter tags different custom ways pre-combining for multi-tag
    • Declan: can probably offer a bunch of options for intra-frame optimization? Longer-term, inter-frame (history of observations)?
    • Factor graphs are another thing we can do
    • Probably just do the naive thing for now? Add a global filtering/localization tab
      • RANSAC (google says Random sample consensus?)
      • distance from camera
      • high ambiguity
      • constrain within field (would need robot pose to be piped in)
      • use gyro heading to help reject tags? (but then you need a gyro)
    • How should we let people upload field layouts and configure them?
      • Select tags that are used
      • One time field layout upload in the UI, with a view showing tag poses somehow
  • Gib h264
    • Gstreamer RTC -- no web
    • WebRTC -- No docs, usable in JavaScript. But we need this if we want browser UDP
    • Manged to get a webrtc stream working in Python to a browser
    • Maybe use a pure Rust/native webRTC implementation and wrap with a JNI
    • You have to do your own encoding and then pass it to WebRTC
    • h264 over websockets?
    • Better to use a real transport like WebRTC over a custom DIY websockets approach
    • LibAV can do some degree of cross-platform hardware acceleration, but it's a PITA to write code for
    • Libcamera seems to have a way to encode frames? https://github.com/raspberrypi/libcamera-apps/blob/a6267d51949d0602eedf60f3ddf8c6685f652812/apps/libcamera_raw.cpp#L70
    • We would probably really want hardware acceleration to run real-time h264 encoding
  • Sim refactor PR
    • 3044 was pretty happy
    • Maybe just merge and document the features?
    • Make it a hard transition from the old sim classes
    • Yank example from AprilTagWorkbench
  • Settings robustness
    • Should we just move to SQL?
    • Should we export all the files as a db, or a JSON?
    • We should export/import JSON ZIPs, and save as SQL DB locally so people still have plain-text
  • Camera streaming is super slow on Pi
    • High frame divisor to get good performance
    • Should we have a switch to totally disable streams per-camera in Photon? Just don't draw on input/output or anything, and streaming is a huge drain on Pi resources
  • We should do more profiling on new SBCs (like orange pi) to check on bottlenecks
  • Status LED/camera LEDs shouldn't be tied to a single Camera anymore
    • Dumb
    • We should have a GUI to map physical hardware to cameras
  • Frontend Vue refactor PR (we should merge it)
  • Proper robotpy support issues are open (836, ownership transfer into monorepo would be cool?)
  • GPU accel
    • unionfind in GPU!
    • someone should mess with orange pi v4l
  • Poke FIRST about usage reporting again
  • Libcamera shader: oversaturated colors are blown out and wrap around
  • Camera calibration rework
    • mrcal has a c API, technically
    • Desktop app wrapping mrcal python seems easy
    • Can find points using whatever you want (for us, that's openCV)
    • List of points is all mrcal needs, but it'll annotate snapshots
    • Can we wasm mrcal? (Banks: lots of dependencies, fortran, ewww, no; stick with prebuilt python wheel)
    • charuco board support?? for real this time??

Clone this wiki locally