stemedb/applications/aphoria/dogfood/msgqueue/src/processor.rs
jml 3dac3dc914 feat(aphoria): implement Day 3 debugging features and comprehensive documentation
Implements all product gaps identified in msgqueue Day 3 evaluation (VG-DAY3-001/003/004)
and adds comprehensive documentation to prevent dogfooding failures.

## Product Features (VG-DAY3-XXX)

### VG-DAY3-001: --show-observations flag (P0)
- Shows all observations with concept paths for debugging extractor alignment
- Includes claim matching analysis (/ visual feedback)
- Explains tail-path matching and why observations don't match claims
- 8 unit tests in src/report/observations.rs
- 5 integration tests in src/tests/day3_debugging.rs

### VG-DAY3-003: aphoria extractors validate (P2)
- Validates extractor subject fields match claim concept_paths
- Smart fuzzy matching suggests corrections for typos
- Clear error messages with actionable hints
- Proper exit codes (0=success, 1=validation failed)

### VG-DAY3-004: aphoria extractors test NAME --file (P2)
- Tests single extractor pattern against one file (no full scan needed)
- Shows line numbers and matched text
- Previews what observation would be created
- Helpful troubleshooting when pattern doesn't match

## Documentation (P0-P1)

### New Docs Created
- docs/extractors/declarative-extractors.md (800 lines)
  - Complete field reference with emphasis on subject field format
  - 3 worked examples (timeout=0, unbounded queue, TLS disabled)
  - Common mistakes with fixes
  - Validation workflow
  - Debugging 0% detection rate

- docs/examples/extractors/timeout-zero-example.md (500 lines)
  - End-to-end flow: code → extractor → claim → conflict → fix
  - Visual diagrams showing path alignment
  - Troubleshooting guide
  - Validation checklist

- docs/dogfooding-common-mistakes.md (560 lines)
  - Mistake #1: Skipping Day 3 extractor creation (CRITICAL)
  - Mistake #2: Creating extractors with wrong subject format (NEW)
  - Evidence from msgqueue failures
  - Recovery procedures

### Docs Updated
- dogfood/msgqueue/plan.md (Day 3 Steps 3-4)
  - Added complete manual declarative extractor TOML format
  - Added validation workflow BEFORE scanning
  - Added debug workflow for 0% detection after creating extractors

- dogfood/msgqueue/eval/ (evaluation artifacts)
  - EVALUATION-REPORT-2026-02-10.md (600 lines)
  - DOC-FIXES-2026-02-10.md (summary of fixes)
  - IMPLEMENTATION-REVIEW-2026-02-10.md (feature review)

## New Extractors
- src/extractors/ack_mode_config.rs - Detects AckMode::AutoAck violations
- src/extractors/async_blocking.rs - Detects blocking calls in async functions
- src/extractors/unbounded_resources.rs - Detects unbounded queues/connections

## Code Changes
- src/cli/mod.rs: Add --show-observations flag to scan command
- src/cli/extractors.rs: Add Validate and Test subcommands
- src/handlers/scan.rs: Call format_observations when flag enabled
- src/handlers/extractors.rs: Implement handle_validate() and handle_test()
- src/report/observations.rs: Observation formatting with claim matching analysis
- src/tests/day3_debugging.rs: Integration tests for new features

## Dogfood Artifacts
- dogfood/msgqueue/ - Complete msgqueue Day 3 evaluation with findings
- dogfood/dbpool/ - Database pool dogfooding exercise

## Impact
- Time savings: 30 min per Day 3 debugging (67% faster)
- User experience: Transparent debugging (no blind trial-and-error)
- Documentation: 1,860 new lines covering all P0-P1 gaps

## Related Issues
- Closes VG-DAY3-001 (--show-observations)
- Closes VG-DAY3-002 (concept path alignment docs)
- Closes VG-DAY3-003 (extractors validate)
- Closes VG-DAY3-004 (extractors test)

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
2026-02-11 03:31:06 +00:00

127 lines
3.7 KiB
Rust

//! Message processor implementation
//!
//! This module contains intentional violations for Aphoria dogfood testing.
use crate::error::ConsumerError;
use std::time::Duration;
use tracing::{info, warn};
/// Message processor that handles incoming messages
pub struct MessageProcessor {
/// Processing mode
mode: ProcessingMode,
}
/// Processing mode
#[derive(Debug, Clone, Copy)]
pub enum ProcessingMode {
/// Synchronous (blocking) processing
Sync,
/// Asynchronous (non-blocking) processing
Async,
}
impl MessageProcessor {
/// Create a new message processor
pub fn new(mode: ProcessingMode) -> Self {
Self { mode }
}
// ==================== VIOLATION 8: Synchronous Processing ====================
/// Process a message (contains blocking operation in async context)
///
/// @aphoria:claim[performance] Message processing MUST be async -- synchronous processing blocks event loop and degrades throughput
pub async fn process_message(&self, data: &[u8]) -> Result<(), ConsumerError> {
info!("Processing message of {} bytes", data.len());
match self.mode {
ProcessingMode::Sync => {
// ❌ VIOLATION 8: Blocking call in async function!
// This blocks the tokio runtime thread, preventing other tasks from running
std::thread::sleep(Duration::from_millis(100));
info!("Message processed (sync mode)");
Ok(())
}
ProcessingMode::Async => {
// ✅ CORRECT: Non-blocking async sleep
tokio::time::sleep(Duration::from_millis(100)).await;
info!("Message processed (async mode)");
Ok(())
}
}
}
/// Batch process multiple messages
pub async fn process_batch(&self, messages: &[&[u8]]) -> Result<usize, ConsumerError> {
let mut processed = 0;
for msg in messages {
if let Err(e) = self.process_message(msg).await {
warn!("Failed to process message: {}", e);
continue;
}
processed += 1;
}
info!("Batch processed: {}/{} messages", processed, messages.len());
Ok(processed)
}
/// Validate message format
pub fn validate_message(&self, data: &[u8]) -> bool {
// Simple validation: message must not be empty
!data.is_empty()
}
}
impl Default for MessageProcessor {
fn default() -> Self {
// ❌ VIOLATION 8: Default to sync mode
Self::new(ProcessingMode::Sync)
}
}
#[cfg(test)]
mod tests {
use super::*;
#[test]
fn test_processor_creation() {
let processor = MessageProcessor::new(ProcessingMode::Async);
assert!(matches!(processor.mode, ProcessingMode::Async));
}
#[test]
fn test_default_processor() {
let processor = MessageProcessor::default();
assert!(matches!(processor.mode, ProcessingMode::Sync));
}
#[test]
fn test_message_validation() {
let processor = MessageProcessor::default();
assert!(processor.validate_message(b"test"));
assert!(!processor.validate_message(b""));
}
#[tokio::test]
async fn test_async_processing() {
let processor = MessageProcessor::new(ProcessingMode::Async);
let result = processor.process_message(b"test data").await;
assert!(result.is_ok());
}
#[tokio::test]
async fn test_batch_processing() {
let processor = MessageProcessor::new(ProcessingMode::Async);
let messages = vec![b"msg1".as_slice(), b"msg2".as_slice(), b"msg3".as_slice()];
let result = processor.process_batch(&messages).await;
assert!(result.is_ok());
assert_eq!(result.unwrap(), 3);
}
}