kdeps-components-web_scraper
v1.0.1kdeps kdeps-component: web_scraper
set components / shelf workflow
PurposeFetch a page through the kdeps API
LLM context: ~29 tokens when loaded (prompt or tool definition)
Where it runs
Part of the components set, used in workflow and agent mode. Ready-made workflow steps (sql, browser, email, git, ocr...) a resource calls by name; in agent mode they are also tools.
- a resource names a component (or the model calls it as a tool)
- the component's own resources runcomponents/web_scraper
- its output goes back to the caller
Loaded by: kdeps (agent loop), /settings, kdeps validate, kdeps run, kdeps bundle package, kdeps env, kdeps export k8s, kdeps test
In the code: kdeps (agent loop)yaml.(*Parser).ParseWorkflowyaml.(*Parser).loadAssetComponents
Install
A kdeps asset: installed with the first-run profile that includes its set, or the first time a command needs it, and updated without a new release.
Also installs what it requires, when missing or older: schemas/v1, tools/web_scraper.
Pin a version with kdeps install components/web_scraper@<version>.
Contents
component.yaml
apiVersion: kdeps.io/v1
kind: Component
metadata:
name: web_scraper
description: Fetch a page through the kdeps API
version: "1.0.1"
interface:
inputs:
- name: url
type: string
required: true
description: Page URL
output: "{{ output('call').body }}"
resources:
- actionId: call
name: Fetch
httpClient:
method: POST
url: http://kdeps.api/apis/tools.kdeps.io/v1/tools/web_scraper/call
headers:
Content-Type: application/json
failOnError: true
timeout: 60s
data:
url: "{{ get('web_scraper.url') }}"
requires:
schemas/v1: ""
tools/web_scraper: ""
version: 1.0.1
requires:
schemas/v1: ""
tools/web_scraper: ""
files:
component.yaml: |
apiVersion: kdeps.io/v1
kind: Component
metadata:
name: web_scraper
description: Fetch a page through the kdeps API
version: "1.0.1"
interface:
inputs:
- name: url
type: string
required: true
description: Page URL
output: "{{ output('call').body }}"
resources:
- actionId: call
name: Fetch
httpClient:
method: POST
url: http://kdeps.api/apis/tools.kdeps.io/v1/tools/web_scraper/call
headers:
Content-Type: application/json
failOnError: true
timeout: 60s
data:
url: "{{ get('web_scraper.url') }}"
Versions
| Version | Published | Status |
|---|---|---|
| 1.0.1 | 10/21/2026 | active |
| 1.0.0 | 10/20/2026 | active |
Details
- Author
- kdeps
- License
- Apache-2.0
- Latest Version
- 1.0.1
- Published
- 10/20/2026