Selfuel Docs
  • Welcome to Selfuel Platform
    • Features
    • Capabilities
    • Target Audience
    • $150 Free Trial
  • Registration and Login
  • Platform UI
  • Stream Processing with Cortex
    • Cortex Quickstart Guide
    • Cortex Elements
      • Streams
      • Attributes
      • Mappings
        • 🚧Source Mapping Types
        • 🚧Sink Mapping Types
      • Node and Application Healthchecks
      • Nodes
        • Node Preview
        • Node Connectivites
        • Node Units
      • Expression Builder
        • 🚧Built-in Functions
      • Windows
        • Cron Window
        • Delay Window
        • Unique Event Window
        • First Event Window
        • Sliding Event Count Window
        • Tumbling Event Count Window
        • Session Window
        • Tumbling Event Sort Window
        • Sliding Time Window
        • Tumbling Time Window
        • Sliding Time and Event Count Window
      • Store and Cache
        • RDBMS
        • MongoDB
        • Redis
        • Elasticsearch
    • Applications
      • Applications Page
      • Creating Applications using Canvas
      • Connector Nodes Cluster
        • Source Nodes
          • CDC Source
          • Email Source
          • HTTP Source
          • HTTP Call Response Source
          • HTTP Service Source
          • Kafka Source
          • RabbitMQ Source
          • gRPC Source
          • JMS Source
          • Kafka Multi DC Source
          • JMS Source
          • AWS S3 Source
          • Google Pub-sub Source
          • AWS SQS Source
          • MQTT Source
          • Google Cloud Storage Source
          • HTTP SSE Source
          • WebSubHub Source
        • Sink Nodes
          • Email Sink
          • HTTP Sink
          • HTTP Service Response Sink
          • HTTP Call Sink
          • Kafka Sink
          • RabbitMQ Sink
          • gRPC Sink
          • JMS Sink
          • Kafka Multi DC Sink
          • AWS S3 Sink
          • Google Pub-sub Sink
          • AWS SQS Sink
          • MQTT Sink
          • Google Cloud Storage Sink
          • HTTP SSE Sink
          • WebSubHub Sink
      • Processing Nodes Cluster
        • Query
        • Join
        • Pattern
        • Sequence
        • Processor
        • 🚧On-demand Query
      • Buffer Nodes Cluster
        • Stream
        • Table
        • Window
        • Aggregation
        • Trigger
    • Run Applications
      • Run Applications Using Runners
      • Update Running Applications
      • Application Versioning
  • Data Integration with Nexus
    • Nexus Quickstart Guide
    • Nexus Elements
      • Concept
        • Config
        • Schema Feature
        • Speed Control
      • Connectors
        • Source
          • Source Connector Features
          • Source Common Options
          • AmazonDynamoDB
          • AmazonSqs
          • Cassandra
          • Clickhouse
          • CosFile
          • DB2
          • Doris
          • Easysearch
          • Elasticsearch
          • FakeSource
          • FtpFile
          • Github
          • Gitlab
          • GoogleSheets
          • Greenplum
          • Hbase
          • HdfsFile
          • Hive
          • HiveJdbc
          • Http
          • Apache Iceberg
          • InfluxDB
          • IoTDB
          • JDBC
          • Jira
          • Kingbase
          • Klaviyo
          • Kudu
          • Lemlist
          • Maxcompute
          • Milvus
          • MongoDB CDC
          • MongoDB
          • My Hours
          • MySQL CDC
          • MySQL
          • Neo4j
          • Notion
          • ObsFile
          • OceanBase
          • OneSignal
          • OpenMldb
          • Oracle CDC
          • Oracle
          • OssFile
          • OssJindoFile
          • Paimon
          • Persistiq
          • Phoenix
          • PostgreSQL CDC
          • PostgreSQL
          • Apache Pulsar
          • Rabbitmq
          • Redis
          • Redshift
          • RocketMQ
          • S3File
          • SftpFile
          • Sls
          • Snowflake
          • Socket
          • SQL Server CDC
          • SQL Server
          • StarRocks
          • TDengine
          • Vertica
          • Web3j
          • Kafka
        • Sink
          • Sink Connector Features
          • Sink Common Options
          • Activemq
          • AmazonDynamoDB
          • AmazonSqs
          • Assert
          • Cassandra
          • Clickhouse
          • ClickhouseFile
          • CosFile
          • DB2
          • DataHub
          • DingTalk
          • Doris
          • Druid
          • INFINI Easysearch
          • Elasticsearch
          • Email
          • Enterprise WeChat
          • Feishu
          • FtpFile
          • GoogleFirestore
          • Greenplum
          • Hbase
          • HdfsFile
          • Hive
          • Http
          • Hudi
          • Apache Iceberg
          • InfluxDB
          • IoTDB
          • JDBC
          • Kafka
          • Kingbase
          • Kudu
          • Maxcompute
          • Milvus
          • MongoDB
          • MySQL
          • Neo4j
          • ObsFile
          • OceanBase
          • Oracle
          • OssFile
          • OssJindoFile
          • Paimon
          • Phoenix
          • PostgreSql
          • Pulsar
          • Rabbitmq
          • Redis
          • Redshift
          • RocketMQ
          • S3Redshift
          • S3File
          • SelectDB Cloud
          • Sentry
          • SftpFile
          • Slack
          • Snowflake
          • Socket
          • SQL Server
          • StarRocks
          • TDengine
          • Tablestore
          • Vertica
        • Formats
          • Avro format
          • Canal Format
          • CDC Compatible Debezium-json
          • Debezium Format
          • Kafka source compatible kafka-connect-json
          • MaxWell Format
          • Ogg Format
        • Error Quick Reference Manual
      • Transform
        • Transform Common Options
        • Copy
        • FieldMapper
        • FilterRowKind
        • Filter
        • JsonPath
        • LLM
        • Replace
        • Split
        • SQL Functions
        • SQL
    • Integrations
      • Integrations Page
      • Creating Integrations Using Json
    • Run Integrations
      • Run Integrations Using Runners
      • Integration Versioning
  • Batch Processing/Storage with Maxim
    • Maxim Quickstart Guide
    • Maxim Elements
    • Queries
    • Run Queries
  • Orchestration with Routines
    • Routines Quickstart Guide
    • Routines Elements
    • Routines
    • Run Routines
  • Runners
    • Runners Page
    • Create a Runner to Run Applications
  • Security
    • Vaults
      • Vaults Page
      • Create Vaults
        • Runner-level Vaults
        • Application-level Vaults
      • Edit and Delete Vaults
      • 🚧Utilizing Vaults in Applications and Runners
    • Certificates
      • Certificates Page
      • 🚧Utilizing Certificates in Applications
      • 🟨Setting Up Security Settings
  • Monitoring Performance
    • Dashboard
    • Application Details
    • Runner Details
  • Logging
    • Log Types
  • Cost Management
    • SaaS
      • Pay-as-you-go
        • Hard Budget Cap
        • Soft Budget Cap
      • Subscriptions
    • On-prem
  • Organization Settings
    • General
    • Access Controls
      • User Roles and Privileges
    • Current Costs
    • Billing Addresses
    • Payment Accounts
    • Subscriptions
    • Pricing
    • Invoicing
  • User Settings
  • Troubleshooting
  • FAQs
Powered by GitBook
On this page
  • Step 4 - Connection and Security Settings
  • Enable Basic Authentication
  • Client Certification Verification Type
  • SSL/TLS Protocol
  • TLS Store Type
  • SSL/TLS Configurations
  • Step 5 - Worker and Connection Management
  • HTTP Connection Idle Timeout
  • Server Bootstrap Configurations
  • Step 6 - Request and Header Validations
  • HTTP Request Size Validation Settings
  • HTTP Header Validation Settings
  • Step 7 - Preview
  1. Stream Processing with Cortex
  2. Applications
  3. Connector Nodes Cluster
  4. Source Nodes

HTTP Source

Step 4 - Connection and Security Settings

Enable Basic Authentication

Works only in VM, Docker, and Kubernetes. When turned on, it authenticates each request using the Authorization header encoded in Base64 format as 'Basic encodeBase64(username:Password)'.

Default Value
Possible Data Type

OFF

STRING

Client Certification Verification Type

Specifies the type of client certificate verification required. The supported values are 'Require' and 'Optional'.

Default Value
Possible Data Type

SSL/TLS Protocol

Indicates the SSL/TLS protocol being used.

Default Value
Possible Data Type

TLS

TLS Store Type

Specifies the type of TLS store.

Default Value
Possible Data Type

JKS

STRING

SSL/TLS Configurations

Specifies configurations for SSL/TLS in the key-value pairs. Vaules can be separated by commas (',') Some supported parameters can be exemplified as

  • SSL/TLS protocols: ‘sslEnabledProtocols' as key and 'TLSv1.1,TLSv1.2’ as values.

  • List of ciphers: ‘ciphers’ as key and 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' as value.

  • Supported server names: ‘server.supported.server.names’ as key and 'server_name’ as value.

  • Add HTTP SNIMatcher: ‘server.supported.snimatcher' as key and 'SNIMatcher’ as value.

Default Value
Possible Data Type

STRING

Step 5 - Worker and Connection Management

HTTP Connection Idle Timeout

The time in milliseconds for which the HTTP connection can remain idle before timeout.

Default Value
Possible Data Type

120000

INTEGER

Server Bootstrap Configurations

Configurations for server bootstrap in the key-value format. Some supported configurations can be exemplified as

  • Server Connection Timeout in milliseconds: 'server.bootstrap.connect.timeout' as key and '15000' as value.

  • Server Socket Timeout in seconds: 'server.bootstrap.socket.timeout' as key and '20' as value.

  • Enable TCP No Delay: ‘server.bootstrap.nodelay' as key and 'true' as value.

  • Enable Server Keepalive: 'server.bootstrap.keepalive' as key and 'true' as value.

  • Send Buffer Size: 'server.bootstrap.sendbuffersize' as key and '1048576’ as value.

  • Receive Buffer Size: 'server.bootstrap.receivebuffersize' as key and '1048576’ as value.

  • Number of Connections Queued: 'server.bootstrap.socket.baklog' as key and '150’ as value.

Default Value
Possible Data Type

STRING

Step 6 - Request and Header Validations

HTTP Request Size Validation Settings

Configurations for validating the size of HTTP requests in key-value format. Some supported configurations can be exemplified as

  • Enable Request Size Validation: 'request.size.validation' as the key and 'true' as value.

  • If request size is validated:

    • Maximum Request Size: 'request.size.validation.maximum.value' as key and '2048' as value.

    • Response Status Code when Request Size Validation fails: 'request.size.validation.reject.status.code' as key and '401' as value.

    • Response Message when Request Size Validation fails: 'request.size.validation.reject.message' as key and 'Message is bigger than the valid size(or any message)' as value.

    • Response Content-Type when Request Size Validation fails: 'request.size.validation.reject.message.content.type' as key and 'plain/text' as value.

Default Value
Possible Data Type

STRING

HTTP Header Validation Settings

Configurations for validating HTTP headers in the key-value format. Some supported configurations can be exemplified as

  • Enable Header Size Validation: 'header.size.validation' as key and 'true' as value.

  • If header size is validated

    • Maximum Length of Initial Line: 'header.validation.maximum.request.line' as key and '4096' as value.

    • Maximum Length of All Headers: 'header.validation.maximum.size' as key and '8192' as value.

    • Maximum Length of the Content or Each Chunk: 'header.validation.maximum.chunk.size' as key and '8192' as value.

    • Response Status Code when Header Validation Fails: 'header.validation.reject.status.code' as key and '401' as value.

    • Response Message when Header Validation Fails: 'header.validation.reject.message' as key and 'Message header is bigger than the valid size(or any message)' as value.

    • Response Content-Type when Header Validation Fails: 'header.validation.reject.message.content.type' as key and 'plain/text' as value.

Default Value
Possible Data Type

STRING

Step 7 - Preview

In Preview Step, you're provided with a concise summary of all the changes you've made to the HTTP Source Node. This step is pivotal for reviewing and ensuring that your configurations are as intended before completing node setup.

  • Viewing Configurations: Preview Step presents a consolidated view of your node setup.

  • Saving and Exiting: Use the Complete button to save your changes and exit the node and return back to Canvas.

  • Revisions: Use the Back button to return to any Step of modify node setup.

The Preview Step offers a user-friendly summary to manage and finalize node settings in Cortex.

PreviousEmail SourceNextHTTP Call Response Source

Last updated 1 year ago