242 Commits

Author SHA1 Message Date
Robert Rosca
aa7a81e0ca
feat: add openai service tier configuration option (#2339) 2026-01-03 19:31:41 +00:00
Mohamed Bassem
f69b35f83d fix(docs): remove horizontal scrolling in docs 2026-01-02 19:21:48 +00:00
Mohamed Bassem
4b54eeec0e release(docs): release the 0.30 docs 2026-01-01 10:58:22 +00:00
Mohamed Bassem
5537fe85ed
feat: Add open telemetry (#2318)
* feat: add OpenTelemetry tracing infrastructure

Introduce distributed tracing capabilities using OpenTelemetry:

- Add @opentelemetry packages to shared-server for tracing
- Create tracing utility module with span helpers (withSpan, addSpanEvent, etc.)
- Add tRPC middleware for automatic span creation on API calls
- Initialize tracing in API and workers entry points
- Add demo instrumentation to bookmark creation and crawler worker
- Add configuration options (OTEL_TRACING_ENABLED, OTEL_EXPORTER_OTLP_ENDPOINT, etc.)
- Document tracing configuration in environment variables docs

When enabled, traces are collected for tRPC calls, bookmark creation flow,
and crawler operations, with support for any OTLP-compatible backend (Jaeger, Tempo, etc.)

* refactor: remove tracing from workers for now

Keep tracing infrastructure but remove worker instrumentation:
- Remove tracing initialization from workers entry point
- Remove tracing instrumentation from crawler worker
- Fix formatting in tracing files

The tracing infrastructure remains available for future use.

* add hono and next tracing

* remove extra span logging

* more fixes

* update config

* some fixes

* upgrade packages

* remove unneeded packages

---------

Co-authored-by: Claude <noreply@anthropic.com>
2025-12-29 17:11:16 +00:00
Mohamed Bassem
267db79129
feat: support archiving as pdf (#2309)
* feat: support archiving as pdf

* add supprot for manually triggering pdf downloads

* fix submenu

* menu cleanup

* fix store pdf
2025-12-27 09:59:39 +00:00
rzxczxc
bb6b742a04
feat: add OPENAI_PROXY_URL configuration and support for proxy in OpenAI client (#2231)
* Add OPENAI_PROXY_URL configuration and support for proxy in OpenAIInferenceClient

* docs: add OPENAI_PROXY_URL configuration for proxy support in OpenAI API requests

* format

---------

Co-authored-by: Mohamed Bassem <me@mbassem.com>
2025-12-27 09:24:52 +00:00
Mohamed Bassem
4762da12cc docs: shuffle some docs around 2025-12-22 13:52:14 +00:00
Mohamed Bassem
903aa5e96c
docs: add RSS feeds integration documentation (#2288)
* docs: add RSS feeds integration documentation

Add detailed documentation for RSS feed integration covering:
- Publishing lists as RSS feeds with authentication tokens
- Consuming external RSS feeds with automatic bookmark creation
- Feed scheduling and management features
- Configuration options and troubleshooting guides
- API access and best practices

* changes

---------

Co-authored-by: Claude <noreply@anthropic.com>
2025-12-22 13:46:32 +00:00
Mohamed Bassem
9021822a05 docs: Add icons beside category names 2025-12-18 04:20:24 +00:00
Mohamed Bassem
f111cba937 docs: fix sidebar on mobile 2025-12-13 15:57:00 +00:00
Mohamed Bassem
74df8bd789 feat: Add limits on number of rss feeds and webhooks per user 2025-12-13 14:36:37 +00:00
Mohamed Bassem
c6cf4188cd docs: Update screenshots in docs 2025-12-13 12:17:29 +00:00
Mohamed Bassem
04b9c29170 docs: Adding user guides 2025-12-13 12:03:55 +00:00
Mohamed Bassem
fecb0079d0 docs: drop docs for old versions 2025-12-13 11:11:55 +00:00
Mohamed Bassem
af69f637cc docs: restructure the docs 2025-12-13 11:05:05 +00:00
Mohamed Bassem
b43444018e docs: restyle the docs 2025-12-13 09:53:10 +00:00
Mohamed Bassem
480abce478 deps: Upgrade to nodejs 24 2025-12-13 07:37:33 +00:00
Claude
91784cd20c feat: make asset preprocessing worker timeout configurable
- Added ASSET_PREPROCESSING_JOB_TIMEOUT_SEC environment variable with default of 60 seconds (increased from hardcoded 30 seconds)
- Updated worker to use the configurable timeout from serverConfig
- Added documentation for the new configuration option
2025-12-10 08:23:43 +00:00
Mohamed Bassem
1f43f232f7
feat: add is:broken search qualifier for broken links (#2225)
Add a new search qualifier `is:broken` that allows users to filter bookmarks
with broken or failed links. This matches the functionality on the broken links
settings page, where a link is considered broken if:
- crawlStatus is "failure"
- crawlStatusCode is less than 200
- crawlStatusCode is greater than 299

The qualifier supports negation with `-is:broken` to find working links.

Changes:
- Add brokenLinks matcher type definition
- Update search query parser to handle is:broken qualifier
- Implement query execution logic for broken links filtering
- Add autocomplete support with translations
- Add parser tests
- Update search query language documentation

Co-authored-by: Claude <noreply@anthropic.com>
2025-12-08 00:31:46 +00:00
Flo
9a33938529
docs: add karakeep integration for Home Assistant (#2196)
* Update 13-community-projects.md

Add Karakeep integration for Home Assistant

* Update docs/docs/13-community-projects.md

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* Update docs/docs/13-community-projects.md

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* Update 13-community-projects.md

---------

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2025-11-30 15:22:53 +00:00
Mohamed Bassem
97c386a4d1 release(docs): release the 0.29 docs 2025-11-29 18:32:19 +00:00
Aaron Korte
6912d0dd4e
docs: Add LOG_LEVEL to configuration documentation (#2166)
* Add LOG_LEVEL to configuration options

Added LOG_LEVEL configuration option for application logging.

* Add missing trailing pipe
2025-11-23 15:23:26 +00:00
David
9fedfc15aa
docs: fix link to raycast extension (#1923)
* Update 13-community-projects.md

Updated the Raycast Extension link

* tests: Add a test for listing lists

* fix link

* empty

* empty

---------

Co-authored-by: Mohamed Bassem <me@mbassem.com>
2025-11-23 15:15:19 +00:00
Mohamed Bassem
67b8a3c141 fix: add a way to allowlist all domains from ip validation 2025-11-22 13:58:27 +00:00
Mohamed Bassem
391af8a523 deps: Upgrade typescript to 5.9 2025-11-16 12:28:28 +00:00
Mohamed Bassem
4cf0856e39
feat: add crawler domain rate limiting (#2115) 2025-11-09 21:20:54 +00:00
Mohamed Bassem
d9ef832e0b release(docs): release the 0.28 docs 2025-11-08 21:29:59 +00:00
Mohamed Bassem
965c603de3 feat: Make search job timeout configurable 2025-11-02 19:32:34 +00:00
Mohamed Bassem
b63a49fc39
fix: Stricter SSRF validation (#2082)
* fix: Stricter SSRF validation

* skip dns resolution if running in proxy context

* more fixes

* Add LRU cache

* change the env variable for internal hostnames

* make dns resolution timeout configerable

* upgrade ipaddr

* handle ipv6

* handle proxy bypass for request interceptor
2025-11-02 17:19:28 +00:00
Christoph Vollmann
bd9c933bc0
docs: Add Azure configuration details for OpenAI-compatible API (#2072)
* docs: Add Azure configuration details for OpenAI-compatible API

* Update docs/docs/14-guides/05-different-ai-providers.md

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-10-26 15:09:36 +00:00
Mohamed Bassem
cf3ffff0a5 feat: Allow configuring inline asset size threshold 2025-10-26 11:17:16 +00:00
Mohamed Bassem
6ea5dd194e
refactor: generalize tidy assets queue into admin maintenance (#2059)
* refactor: generalize admin maintenance queue

* more fixes
2025-10-26 09:58:51 +00:00
Benjamin Michaelis
046c29dcf1
fix: update OpenAI API to use max_completion_tokens instead of max_tokens (#2000)
* fix: update OpenAI API to use max_completion_tokens instead of max_tokens

The OpenAI API has deprecated max_tokens in favor of max_completion_tokens
for newer models. This change updates both text and image model calls.

* feat: add support for max_completion_tokens in OpenAI inference configuration
2025-10-25 19:12:08 +01:00
Mohamed Bassem
c14b69346a
feat: support passing multiple proxy values (#2039)
* feat: support passing multiple proxy values

* fix typo

* trim and filter
2025-10-12 22:25:29 +01:00
Siddharth Doshi
36ffbdf8b5
docs: Add karakeep-sync to community projects (#1994)
Added a new community project for syncing links from Hacker News and Reddit to Karakeep.
2025-10-11 13:40:00 +01:00
Clayton O'Neill
5e331a7d5b
docs: Add doc updates for prometheus metrics (#1957)
This adds documentation for `WORKERS_HOST` and clarifies token
requirements for `PROMETHEUS_AUTH_TOKEN`.
2025-09-28 22:29:10 +01:00
Mohamed Bassem
783f72cb91 feat: Add scripts to migrate all content from one server to the other 2025-09-14 12:47:21 +00:00
Mohamed Bassem
a92ada7727
feat(search): add title search qualifier (#1940)
* fix(search): include link titles in title matcher

* docs(search): add title qualifier

* docs: remove title qualifier from v0.27 guide
2025-09-13 21:37:56 +01:00
Mohamed Bassem
251aa3708e docs: establish cloudflare redirects after the new lowercase docs 2025-09-07 18:54:18 +00:00
Mohamed Bassem
4292a13d77 fix(docs): fix links to point to lowercase docs 2025-09-07 18:46:32 +00:00
Mohamed Bassem
13856a1fb3 release(docs): release the 0.27 docs 2025-09-07 17:51:12 +00:00
Mohamed Bassem
c57fd5137c
feat: Add cookie support for browser page access
* feat: Add cookie support for browser page access

Implemented cookie functionality for browser page access, including BROWSER_COOKIE_PATH configuration to specify the cookies JSON file path.

* fix the docs

---------

Co-authored-by: lizz <lizong1204@gmail.com>
2025-09-07 15:47:38 +01:00
Mohamed Bassem
492b152038
feat(workers): add worker enable/disable lists (#1885) 2025-09-07 15:32:24 +01:00
Mohamed Bassem
67c394efb3 readme: Add floccus support to readme and docs 2025-09-07 12:51:52 +00:00
Olicorne
1976c537c7
docs: readme mentions importers + enhancements (#1448)
* doc: fix link to yt-dlp + on its own line

* doc: better teaser in the readme

* doc: mention the importers as features

* doc: mention clients exist

* doc: fix typo

* minor modifications

---------

Co-authored-by: Mohamed Bassem <me@mbassem.com>
2025-09-07 13:49:00 +01:00
Yinan
50d426f777
fix(docs): typo: Optaining -> Obtaining in 09-command-line.md (#1850) 2025-08-30 22:26:50 +01:00
Olicorne
d455c70491
doc: clarify that groups can't be negated (#1881) 2025-08-30 21:32:02 +01:00
MohamedBassem
52d018c872 feat: Export prometheus metrics from the workers 2025-08-22 21:20:37 +03:00
MohamedBassem
a64307e8ac feat: generate a random prometheus token on startup 2025-08-22 21:20:37 +03:00
MohamedBassem
ff33b310e2 Revert "deps: Upgrade nextjs to 15.5"
This reverts commit be420c9aebb0f2d343a0c94327fddc089f56d402.
2025-08-20 18:14:49 +03:00