0cb8ab2162
* feat: implement structured outputs for Cerebras, OpenRouter, OpenAI, and Apple Intelligence
- Add structured output support with JSON schema in llm_client.rs
- Update actions.rs to use system prompt + user content approach
- Remove legacy ${output} variable substitution for supported providers
- Update Apple Intelligence Swift code to accept system prompts
- All providers now use consistent structured output format
- Remove duplicate check_apple_intelligence_availability function
* wip changes
* fix(structured-outputs): address PR #706 review comments
- Add settings migration to sync supports_structured_output field for existing providers
- Fix fallback behavior: structured output failures now fall through to legacy mode
- Clone api_key to prevent ownership issues in fallback path
- Clean up build_system_prompt(): remove placeholder entirely
(instead of replacing with 'the user's message' which reads awkwardly)
- Add warn import from log crate
* refactor(structured-outputs): apply best practice improvements
- Optimize settings migration: use single match instead of double iteration
- Add TRANSCRIPTION_FIELD constant to replace magic strings
- Keep Apple Intelligence behavior unchanged (no API fallback for privacy)
Addresses code review feedback on PR #706:
1. More efficient provider lookup in ensure_post_process_defaults()
2. Eliminates hardcoded 'transcription' string in JSON parsing
3. Maintains privacy-first approach for Apple Intelligence
* fix groq output
---------
Co-authored-by: CJ Pais <cj@cjpais.com>
29 lines
No EOL
829 B
C
29 lines
No EOL
829 B
C
#ifndef apple_intelligence_bridge_h
|
|
#define apple_intelligence_bridge_h
|
|
|
|
// C-compatible function declarations for Swift bridge
|
|
|
|
#ifdef __cplusplus
|
|
extern "C" {
|
|
#endif
|
|
|
|
typedef struct {
|
|
char* response;
|
|
int success; // 0 for failure, 1 for success
|
|
char* error_message; // Only valid when success = 0
|
|
} AppleLLMResponse;
|
|
|
|
// Check if Apple Intelligence is available on the device
|
|
int is_apple_intelligence_available(void);
|
|
|
|
// Process text using Apple's on-device LLM with separate system prompt and user content
|
|
AppleLLMResponse* process_text_with_system_prompt_apple(const char* system_prompt, const char* user_content, int max_tokens);
|
|
|
|
// Free memory allocated by the Apple LLM response
|
|
void free_apple_llm_response(AppleLLMResponse* response);
|
|
|
|
#ifdef __cplusplus
|
|
}
|
|
#endif
|
|
|
|
#endif /* apple_intelligence_bridge_h */ |