Ultra-high compression data transformation API
// 1. Initialize
const fetcher = new OptimizedDataFetcher({ maxRetries: 3 });
// 2. Fetch heatmap data (type 2)
const heatmapData = await fetcher.fetchHeatmapData(url);
// 3. Fetch revenue/ecommerce data
const revenueData = await fetcher.fetchRevenueData(url);
| Environment | __ENVIRONMENT__ |
| Lambda Function | __LAMBDA_FUNCTION__ |
| API Gateway | __API_ID__ |
| Region | __REGION__ |
| Last Deployed | __DEPLOYMENT_DATE__ |
# Test Lambda
aws lambda invoke \\
--function-name __LAMBDA_FUNCTION__ \\
--payload '{"selfTest":true}' \\
response.json
# View Logs
aws logs tail __LOG_GROUP__ --follow
# Monitor Metrics
aws cloudwatch get-metric-statistics \\
--namespace HeatmapTransform \\
--metric-name Success
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ hm.thehaloplatform.net โ
โ (CloudFront CDN) โ
โโโโโโโโโโโโโโโโโโโโฌโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ
โโโโโโโโโโดโโโโโโโโโ
โ โ
/demo/* /api/*
โ โ
โโโโโโโผโโโโโโโ โโโโโโผโโโโโโโโโโโ
โ S3 Website โ โ API Gateway โ
โ โ โ โ
โ - Demo โ โ /transform โ
โ - Docs โ โ โ โ
โ - Assets โ โ โผ โ
โโโโโโโโโโโโโโ โ Lambda โ
โ โ โ
โ โผ โ
โ S3 Data โ
โโโโโโโโโโโโโโโโโ
Features:
โข Auto-detection (heatmap vs revenue data)
โข 90%+ compression ratio
โข Self-test framework
โข Structured error handling
โข Performance tracking
Transform heatmap or revenue data files with automatic compression
{
"s3Bucket": "your-bucket",
"s3Key": "path/to/data.txt",
"outputKey": "path/to/output.json.gz",
"fileType": "heatmap|revenue" // Optional, auto-detected
}
{
"success": true,
"processingTimeMs": 450,
"metrics": {
"outputSize": 68640,
"uniqueSelectors": 2626,
"compressionRatio": "91.90%"
}
}
POST /api/transform
{
"selfTest": true
}
// Returns: Test results for all transformers
Heatmap Transform Service
Deployed: __DEPLOYMENT_DATE__ | Environment: __ENVIRONMENT__ | Region: __REGION__