llama-gguf-inference
llama-gguf-inference
  • Index

Index

_ | A | B | D | G | H | L | M | P | R | S | T | V

_

  • __init__() (auth.APIKeyValidator method)
    • (gateway.Metrics method)

A

  • APIKeyValidator (class in auth)
  • auth
    • module
  • authenticate_request() (in module auth)

B

  • backend_health_check() (in module gateway)
  • backend_tcp_ready() (in module gateway)
  • bytes_sent (gateway.Metrics attribute)

D

  • do_GET() (health_server.HealthHandler method)

G

  • gateway
    • module
  • get_metrics() (auth.APIKeyValidator method)

H

  • handle_client() (in module gateway)
  • handle_health() (in module gateway)
  • handle_metrics() (in module gateway)
  • handle_ping() (in module gateway)
  • health_server
    • module
  • HealthHandler (class in health_server)

L

  • log() (in module gateway)
  • log_access() (in module auth)
  • log_message() (health_server.HealthHandler method)

M

  • main() (in module gateway)
    • (in module health_server)
  • Metrics (class in gateway)
  • module
    • auth
    • gateway
    • health_server

P

  • proxy_request() (in module gateway)

R

  • requests_active (gateway.Metrics attribute)
  • requests_authenticated (gateway.Metrics attribute)
  • requests_error (gateway.Metrics attribute)
  • requests_success (gateway.Metrics attribute)
  • requests_total (gateway.Metrics attribute)
  • requests_unauthorized (gateway.Metrics attribute)

S

  • send_rate_limit_error() (in module auth)
  • start_time (gateway.Metrics attribute)

T

  • to_dict() (gateway.Metrics method)

V

  • validate() (auth.APIKeyValidator method)

© Copyright 2024, llama-gguf-inference contributors.

Built with Sphinx using a theme provided by Read the Docs.