Add support for other models: different data shapes etc. #3

Open
opened 2026-03-10 14:11:17 +00:00 by leon-adsk · 0 comments
Owner

Two methods:

  1. Built-in Modules: Here we simply provide a way to specify which features should be extracted and in what order the feature vector should be constructed using our built-in Go feature extraction code. Here we should add more modules.
  2. External Python FE: When the Go reverse proxy starts we also start a lightweight Python FastAPI. This reads scripts from a feature extraction server and uses the functions defined there to build an internal API that the Go program can call to extract features both for bulk processing, live detection and threshold finding.

It seems to me that option 2 is the most flexible and desirable so we will proceed for now. We will determine whether the built in methods for feature extraction should remain at all (and be extended in the way described in 1) or if the Python system should fully replace this one.

We will use ZeroMQ for the communication between the Python and Go processes.

Two methods: 1. Built-in Modules: Here we simply provide a way to specify which features should be extracted and in what order the feature vector should be constructed using our built-in Go feature extraction code. Here we should add more modules. 2. External Python FE: When the Go reverse proxy starts we also start a lightweight Python FastAPI. This reads scripts from a feature extraction server and uses the functions defined there to build an internal API that the Go program can call to extract features both for bulk processing, live detection and threshold finding. It seems to me that option 2 is the most flexible and desirable so we will proceed for now. We will determine whether the built in methods for feature extraction should remain at all (and be extended in the way described in 1) or if the Python system should fully replace this one. We will use [ZeroMQ](https://zeromq.org/) for the communication between the Python and Go processes.
leon-adsk added this to the Release v1.0 milestone 2026-03-10 14:13:39 +00:00
leon-adsk changed title from Add support for other models: bring your own onnx to Add support for other models: different data shapes etc. 2026-03-17 15:55:41 +00:00
leon-adsk stopped working 2026-03-31 22:30:36 +00:00
5 hours 17 minutes
leon-adsk deleted spent time 2026-03-31 22:30:43 +00:00
- 5 hours 17 minutes
leon-adsk added spent time 2026-03-31 22:30:53 +00:00
30 minutes
leon-adsk added spent time 2026-04-03 17:14:44 +00:00
15 minutes
leon-adsk stopped working 2026-04-03 18:50:48 +00:00
1 hour 36 minutes
Sign in to join this conversation.
No milestone
No assignees
1 participant
Notifications
Total time spent: 2 hours 21 minutes
leon-adsk
2 hours 21 minutes
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Blocks
#4 Model Chaining Support
leon-adsk/http-anomaly-detection
#13 Advanced Threshold Algorithms
leon-adsk/http-anomaly-detection
Reference
leon-adsk/http-anomaly-detection#3
No description provided.