mirror of
https://github.com/siyuan-note/siyuan.git
synced 2026-07-01 08:16:33 +00:00
* ♻️ Add/update indirect Go dependencies in kernel Update kernel/go.mod and kernel/go.sum to add multiple indirect modules and checksum entries. Notable additions include github.com/fastschema/qjs, github.com/filecoin-project/go-jsonrpc, github.com/ipfs/go-log/v2, go.opencensus.io, go.uber.org/{atomic,multierr,zap}, golang.org/x/xerrors and github.com/golang/groupcache among many transitive entries. Changes ensure transitive dependencies are pinned and go.sum checksums are present (likely produced by `go mod tidy`) to make builds reproducible. * refactor: export bazaar.GetCurrentBackend for kernel plugin platform matching Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * build: promote qjs to direct dependency for kernel plugin system Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat(plugin): add KernelPlugin struct with QJS runtime lifecycle and state machine Introduces plugin/plugin.go with KernelPlugin owning an isolated QuickJS runtime, a mutex-serialized call path, RPC method registration/dispatch, Promise awaiting, JSON round-trip result conversion, and WebSocket tracking. Adds sandbox_stub.go as a temporary no-op stub for injectSandboxGlobals. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat(plugin): add PluginManager singleton for kernel plugin discovery and lifecycle * feat(plugin): add sandbox injection scaffold with siyuan.log Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat(plugin): implement siyuan.storage CRUD scoped to petal storage directory Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat(plugin): implement siyuan.fetch with browser-like Response interface * feat(plugin): implement siyuan.socket with browser-compatible WebSocket API - Add sync import for mutex-protected WebSocket connection tracking - Implement __siyuan_socket Go function that creates browser-compatible WebSocket objects - Support send() method with queueing for messages sent before connection opens - Support close() method for closing the WebSocket connection - Track connection state via readyState property (0=CONNECTING, 1=OPEN, 3=CLOSED) - Connect to kernel WebSocket endpoint with automatic auth token injection - Run WebSocket I/O in background goroutine with proper cleanup - Wire up siyuan.socket JS API Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat(plugin): implement siyuan.rpc.register for JSON-RPC method registration * feat(plugin): add JSON-RPC 2.0 handler for kernel plugin method dispatch * feat(plugin): register /api/plugin/rpc/:name and /ws/plugin/rpc/:name routes Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat(plugin): wire kernel plugin manager start/stop into main lifecycle * feat(plugin): hook SetPetalEnabled to start/stop kernel plugins on enable/disable * test(plugin): add unit tests for kernel plugin state machine and eligibility * test(plugin): add comprehensive unit tests for manager, sandbox, and RPC handlers * refactor(plugin): Export IsTargetSupported and update usages Rename isTargetSupported to exported IsTargetSupported and adjust its comment. Replace local calls with bazaar.IsTargetSupported in kernel/bazaar and kernel/plugin/manager, removing the duplicated isKernelEligible helper. Update tests to import bazaar, call the new function, and change expectations to reflect that nil/empty kernel slices are treated as supported (i.e. supported on all platforms). * refactor(plugin): initialize PluginManager in main and update related usages * refactor(plugin): update JWT handling and plugin initialization for kernel plugins * refactor(plugin): enhance plugin initialization and improve sandbox global injections * refactor(kernel-plugin): Refactor plugin RPC registration and sandbox integration - Removed deprecated tests and refactored existing tests for clarity and efficiency. - Updated RPC method registration to use `bind` and `unbind` methods for better clarity. - Enhanced the `injectSandboxGlobals` function to include additional properties for the plugin. - Improved error handling in RPC methods and ensured proper state management for plugins. - Added benchmarks for map to JS conversion performance. - Cleaned up unused imports and organized code structure for better readability. * refactor(plugin): enhance concurrency handling and improve WebSocket integration * refactor(kernel-plugin): enhance RPC method handling and improve function registration * feat(kernel-plugin): add RPC method info retrieval and enhance plugin management * refactor(plugin): add plugin management endpoints and enhance plugin info retrieval * refactor(kernel-plugin): enhance RPC method handling and improve plugin info retrieval * refactor(kernel-plugin): improve error handling and response structures in RPC methods * refactor(kernel-plugin): improve error handling in RPC methods and enhance WebSocket closure management * fix(kernel-plugin): initialize sockets and socketMus maps in NewKernelPlugin * feat(kernel-plugin): add wsWrite helper and fix PushNotification omitempty Add wsWrite method on KernelPlugin that acquires the per-connection write mutex before sending a text frame, returning nil for untracked connections. Fix PushNotification's Params field to use omitempty for JSON-RPC 2.0 §4.2 compliance. Add rpc_test.go with newTestWsPair helper and tests for wsWrite. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat(kernel-plugin): add BroadcastNotification and per-connection write mutex Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat(kernel-plugin): expose siyuan.rpc.broadcast in plugin sandbox Add rpc.broadcast(method, params) binding in injectRpc so JS plugins can push JSON-RPC 2.0 notifications to all connected server clients. Fix deadlock by introducing a dedicated socketsMu RWMutex for the sockets map, decoupling socket tracking from the main plugin mutex that is held during Start()/Eval(). * fix(kernel-plugin): double-unlock in send handler and document PushNotification write-safety Remove spurious mu.Unlock() inside the nil-conn branch of injectSocket's CONNECTING-state send handler; the outer unconditional unlock is sufficient, so the inner one causes a panic under concurrent load. Document that PushNotification bypasses per-connection write serialization and must not be called concurrently with BroadcastNotification/wsWrite on the same connection without external locking. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * style(kernel-plugin): align struct field declarations in KernelPlugin Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix(kernel-plugin): omit params field from JsonRpcRequest when nil (JSON-RPC 2.0 §4.1) Per spec, params MAY be omitted; add omitempty so marshaled requests with no parameters do not emit "params":null. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * refactor(kernel-plugin): change JsonRpcRequest.Params to *json.RawMessage A pointer correctly models the three-way distinction: - nil → params key absent (omitted from marshal output via omitempty) - non-nil → params present (null, array, or object) The previous []byte omitempty omitted the key only for nil/empty slices and could not distinguish absent from explicit null on the wire. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * refactor(kernel-plugin): unify method naming conventions and improve JSON-RPC request handling * fix(kernel-plugin): improve WebSocket message handling and ensure thread safety with mutexes * fix(kernel-plugin): enhance WebSocket handling and improve error management in storage methods * fix(kernel-plugin): rename JsonRpcRequestRaw to JsonRpcInboundRequest and update related methods * fix(kernel-plugin): improve plugin management and error handling in kernel plugin methods * fix(kernel-plugin): rename kernel field to kernels and update related references * feat(kernel-plugin): implement logging and improve concurrency handling in plugin manager and storage methods * feat(kernel-plugin): enhance RPC parameter handling and add JSON array parsing support * refactor(kernel-plugin): refactor RPC handling and improve logging functionality * refactor(kernel-plugin): streamline loggerWrapper function and improve error handling in injectFetch * refactor(kernel-plugin): optimize injectFetch function and enhance error handling * feat(kernel-plugin): add onLoaded hook and enhance plugin lifecycle management * feat(kernel-plugin): add ObjectFreeze and ObjectSeal functions to enhance API security * feat(kernel-plugin): add InitJwtKey function to generate JWT signing key * refactor(kernel-plugin): enhance error handling and logging in plugin lifecycle methods * feat(kernel-plugin): improve WebSocket error handling and add concurrency support in BroadcastNotification * feat(kernel-plugin): enhance error handling in storage and fetch methods with panic recovery * feat(kernel-plugin): enhance PluginManager concurrency and error handling with sync.Map and atomic operations * feat(kernel-plugin): refactor PluginState to use atomic operations for improved concurrency * feat(kernel-plugin): add PluginStateLoaded and update state management in plugin lifecycle * refactor(kernel-plugin): update logging level in loadPetals and refactor loggerWrapper return values * feat(kernel-plugin): simplify invokeHook and enhance error handling in Object methods * feat(kernel-plugin): remove obsolete test files for plugin functionality * refactor(kernel-plugin): implement loggerWrapper and rpcParamsToJsValue functions for improved logging and RPC parameter handling * feat(kernel-plugin): introduce Worker for serializing plugin tasks and enhance context management * refactor(worker): enhance task execution with callback support and graceful shutdown - Introduced a callback mechanism in the Task struct to handle results and errors. - Updated the Run method to accept a callback, allowing immediate handling of task results. - Added a RunSync method for synchronous task execution with result retrieval. - Implemented atomic closure state management to prevent task submission after closure. - Enhanced the Close method to ensure graceful shutdown and wait for the worker to finish processing. * feat(kernel-plugin): refactor storage and RPC methods to use PromiseRun for better error handling * feat(kernel-plugin): enhance plugin event handling with lifecycle and RPC event subscriptions * refactor(kernel-plugin): replace PromiseRun with worker.Run for improved error handling in event and storage methods * chore(kernel-plugin): add goja dependency, drop qjs * chore(kernel-plugin): delete KernelPluginLogger (qjs stdout/stderr only) * refactor(kernel-plugin): replace qjs runtime with goja in plugin.go Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * test(kernel-plugin): add sandbox utility tests (pre-rewrite) * refactor(kernel-plugin): rewrite sandbox utility functions for goja Replace goValueToJsValue, getJsContextValue, dispatchEvent with goja implementations; add convertJsonNumbers helper; stub ObjectFreeze and ObjectSeal as no-ops; delete dead qjs-only helpers (invokeRpcMethod, PromiseAwait, rpcParamsToJsValue, parseJsonArrayStringToJsValueArray, parseJsonStringToJsValue, loggerWrapper, ObjectSetDataMethods). Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * refactor(kernel-plugin): rewrite sandbox.go inject functions for goja Replace all qjs-based inject functions (injectGlobalContext, injectPlugin, injectLogger, injectEvent, injectStorage, injectFetch, injectSocket, injectRpc) with goja equivalents. Add ObjectSetDataMethods and loggerWrapper helpers. Remove all remaining qjs dead code; ObjectFreeze/ObjectSeal now call Object.freeze/seal via goja AssertFunction. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * test(kernel-plugin): add plugin lifecycle and RPC integration tests Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * chore(kernel-plugin): go mod tidy after qjs removal Remove fastschema/qjs from go.mod and go.sum, add go-sourcemap as indirect (transitive dep of dop251/goja), mark go-sourcemap indirect. Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com> * fix(kernel-plugin): fix invokeHook early-return on subscribe failure, safe await extraction, and goja value cross-goroutine access in socket methods * refactor(kernel-plugin): replace goValueToJsValue with goValueToJsValueSafely in sandbox functions and tests * feat(plugin): enhance plugin management and error handling - Added GetLoadedPlugin method to retrieve loaded plugin info by name. - Introduced file path for kernel.js in KernelPlugin struct. - Updated Eval method to use the new file path for script execution. - Improved error handling in injectGlobalContext and other injection functions using recover. - Refactored task execution in Worker to use clearer types for task executors and callbacks. - Enhanced storage methods to ensure proper error handling and logging. - Updated loggerWrapper to handle errors more gracefully. - Ensured consistent use of error handling patterns across various plugin methods. * refactor(worker): enhance task execution with goja runtime integration - Updated TaskExecutor and TaskCallback signatures to accept *goja.Runtime. - Modified Worker to start processing tasks with an event loop. - Improved error handling in task execution to catch panics from both executor and callback. - Renamed Close method to Stop for clarity on worker shutdown behavior. * refactor(kernel-plugin): streamline worker implementation and update context handling in plugin methods * refactor(kernel-plugin): update event handler to use byte slices and improve event dispatching * refactor(worker): simplify RunSync method by removing unnecessary select statement * refactor(kernel-plugin): enhance plugin lifecycle management and improve RPC method binding * refactor(kernel-plugin): improve error logging in data methods for better debugging * refactor(kernel-plugin): add version field to plugin data structures and update related methods * refactor(kernel-plugin): replace JsonRpcInboundRequest with JsonRpcRequest and update related methods * refactor(kernel-plugin): enhance plugin lifecycle hooks and improve RPC method invocation * feat(kernel-plugin): improve error handling and response processing in fetch and socket methods * refactor(kernel-plugin): update invokeFunction to handle promise results correctly * refactor(kernel-plugin): streamline event handling and remove unused JSON marshaling functions * refactor(kernel-plugin): improve error handling in start method and add event publishing for lifecycle states * refactor(kernel-plugin): move logging to separate function and execute in goroutines for improved performance * feat(kernel-plugin): add unique ID generation for start and stop events * refactor(kernel-plugin): enhance error handling and concurrency in storage operations Co-authored-by: Copilot <copilot@github.com> * fix(kernel-plugin): remove unexpected resolve in fetch function * feat(kernel-plugin): enhance JSON-RPC request handling with optional parameters and improved error reporting Co-authored-by: Copilot <copilot@github.com> * refactor(kernel-plugin): rename await to async in dispatchEvent function for clarity Co-authored-by: Copilot <copilot@github.com> * fix(kernel-plugin): improve error handling in RPC method execution and hook invocation * feat(kernel-plugin): implement custom JSON marshaling for JsonRpcRequest to handle optional parameters * feat(kernel-plugin): add error codes for plugin state and improve error handling in RPC responses Co-authored-by: Copilot <copilot@github.com> * refactor(kernel-plugin): clean up context usage and improve error logging for RPC methods * feat(kernel-plugin): add buffer method to object for asynchronous data processing * fix(kernel-plugin): Fixed the problem of blocking when plug-in life cycle function is not bound Co-authored-by: Copilot <copilot@github.com> * feat(kernel-plugin): implement public and private web server handlers and enhance request handling Co-authored-by: Copilot <copilot@github.com> * feat(kernel-plugin): enhance server request handling and introduce server handler invocation Co-authored-by: Copilot <copilot@github.com> * feat(kernel-plugin): enhance response handling and add jsValueToBytes conversion utility Co-authored-by: Copilot <copilot@github.com> * feat(kernel-plugin): comment out public web server route in router * feat(kernel-plugin): add WebSocket and EventSource proxy handlers and update sandbox integration Co-authored-by: Copilot <copilot@github.com> * feat(kernel-plugin): implement HTTP proxy handler with response header forwarding * refactor(kernel-plugin): refactor siyuan.client.* methods * feat(kernel-plugin): add support for EventSource with SSE handling and response header forwarding Co-authored-by: Copilot <copilot@github.com> * feat(kernel-plugin): add SSE support using r3labs/sse library for EventSource handling * feat(kernel-plugin): enhance SSE client with onclose event handling Co-authored-by: Copilot <copilot@github.com> * feat(kernel-plugin): implement SSE event handling and error management in server-sent events * feat(kernel-plugin): refactor SSE handling and introduce request handler utility functions Co-authored-by: Copilot <copilot@github.com> * feat(kernel-plugin): enhance WebSocket message handling with buffered amount tracking and cleanup Co-authored-by: Copilot <copilot@github.com> * perf(kernel-plugin): improve WebSocket message handling with channel-based message sending and error management Co-Authored-By: Copilot <copilot@github.com> * refactor(kernel-plugin): remove invokeServerHandler Co-Authored-By: Copilot <copilot@github.com> * feat(kernel-plugin): implement WebSocket message handling with improved structure and error management Co-authored-by: Copilot <copilot@github.com> * refactor(kernel-plugin): Refactor code structure for improved readability and maintainability * refactor(kernel-plugin): streamline HTTP client creation and enhance event source state management Co-authored-by: Copilot <copilot@github.com> * refactor(kernel-plugin): enhance WebSocket and SSE handling with improved closure management and error handling Co-authored-by: Copilot <copilot@github.com> * refactor(kernel-plugin): optimize WebSocket handling by restructuring state management and improving closure logic Co-authored-by: Copilot <copilot@github.com> * refactor(kernel-plugin): simplify header setting and improve null checks in WebSocket and SSE handling Co-authored-by: Copilot <copilot@github.com> * refactor(kernel-plugin): update WebSocket request handling to improve error management and consistency * refactor(kernel-plugin): improve WebSocket error handling by adding close message management Co-authored-by: Copilot <copilot@github.com> * refactor(kernel-plugin): Refactor WebSocket handling to use gws library - Replaced gorilla/websocket with lxzan/gws for WebSocket connections. - Introduced gwsEventHandler to manage WebSocket events with customizable callbacks. - Updated KernelPlugin to track gws connections and handle message broadcasting. - Refactored RPC WebSocket handling to accommodate new gws structure. - Simplified message sending and connection management logic. - Added utility function to check for undefined JavaScript values. Co-authored-by: Copilot <copilot@github.com> * refactor(kernel-plugin): integrate gws library for improved WebSocket handling and error management Co-authored-by: Copilot <copilot@github.com> * refactor(kernel-plugin): remove unnecessary error handling in WebSocket request processing * refactor(kernel-plugin): enhance error logging in WebSocket message handling Co-Authored-By: Copilot <copilot@github.com> * refactor(kernel-plugin): replace gwsEventHandler with WsEventHandler and improve WebSocket management Co-authored-by: Copilot <copilot@github.com> * refactor(kernel-plugin): integrate chanx for improved event handling in SSE * refactor(kernel-plugin): update handleHttpRequest signature to include gin.Context for improved request handling Co-authored-by: Copilot <copilot@github.com> * refactor(kernel-plugin): optimize WebSocket connection management with context and sync mechanisms * refactor(kernel-plugin): improve error handling and context management in WebSocket and HTTP request handling * refactor(kernel-plugin): enhance WebSocket management with context handling and improved error reporting * fix(kernel-plugin): streamline header export and enhance error handling in injectClient function Co-authored-by: Copilot <copilot@github.com> * perf(kernel-plugin): enhance httpProxy and esProxy functions with improved error handling and content management Co-authored-by: Copilot <copilot@github.com> --------- Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com> Co-authored-by: Copilot <copilot@github.com>
1235 lines
34 KiB
Go
1235 lines
34 KiB
Go
// SiYuan - Refactor your thinking
|
|
// Copyright (c) 2020-present, b3log.org
|
|
//
|
|
// This program is free software: you can redistribute it and/or modify
|
|
// it under the terms of the GNU Affero General Public License as published by
|
|
// the Free Software Foundation, either version 3 of the License, or
|
|
// (at your option) any later version.
|
|
//
|
|
// This program is distributed in the hope that it will be useful,
|
|
// but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
// MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
|
// GNU Affero General Public License for more details.
|
|
//
|
|
// You should have received a copy of the GNU Affero General Public License
|
|
// along with this program. If not, see <https://www.gnu.org/licenses/>.
|
|
|
|
package plugin
|
|
|
|
import (
|
|
"context"
|
|
"encoding/json"
|
|
"fmt"
|
|
"os"
|
|
"path/filepath"
|
|
"sync"
|
|
"sync/atomic"
|
|
|
|
"github.com/asaskevich/EventBus"
|
|
"github.com/dop251/goja"
|
|
"github.com/dop251/goja_nodejs/eventloop"
|
|
"github.com/gin-gonic/gin"
|
|
"github.com/google/uuid"
|
|
"github.com/lxzan/gws"
|
|
"github.com/samber/lo"
|
|
"github.com/siyuan-note/logging"
|
|
"github.com/siyuan-note/siyuan/kernel/model"
|
|
"github.com/siyuan-note/siyuan/kernel/util"
|
|
"github.com/smallnest/chanx"
|
|
)
|
|
|
|
type PluginState int64
|
|
|
|
type RpcMethod struct {
|
|
Name string
|
|
Descriptions []string
|
|
Method goja.Callable
|
|
}
|
|
|
|
type RpcMethodInfo struct {
|
|
Name string `json:"name"`
|
|
Descriptions []string `json:"descriptions"`
|
|
}
|
|
|
|
type R map[string]any
|
|
|
|
const (
|
|
EventBusTopicPlugin = "plugin" // Topic to kernel plugin
|
|
EventBusTopicRuntime = "runtime" // Topic to javascript runtime
|
|
)
|
|
|
|
const (
|
|
PluginStateReady PluginState = iota
|
|
PluginStateLoading
|
|
PluginStateLoaded
|
|
PluginStateRunning
|
|
PluginStateStopping
|
|
PluginStateStopped
|
|
PluginStateError
|
|
)
|
|
|
|
func (s PluginState) String() string {
|
|
switch s {
|
|
case PluginStateReady:
|
|
return "ready"
|
|
case PluginStateLoading:
|
|
return "loading"
|
|
case PluginStateLoaded:
|
|
return "loaded"
|
|
case PluginStateRunning:
|
|
return "running"
|
|
case PluginStateStopping:
|
|
return "stopping"
|
|
case PluginStateStopped:
|
|
return "stopped"
|
|
case PluginStateError:
|
|
return "error"
|
|
default:
|
|
return "unknown"
|
|
}
|
|
}
|
|
|
|
// KernelPlugin represents a single kernel-side plugin instance.
|
|
type KernelPlugin struct {
|
|
*model.Petal
|
|
token string // JWT for this plugin
|
|
file string // kernel.js file path named in js runtime (e.g. "plugin-name/kernel.js")
|
|
|
|
worker Worker // Worker for serializing plugin js-call-go (e.g. logger) and go-call-js (e.g. RPC calls) tasks on a single goroutine
|
|
runtime *eventloop.EventLoop // goja event loop runtime for this plugin
|
|
|
|
state atomic.Int64 // PluginState
|
|
|
|
context context.Context // Context for managing plugin lifecycle and cancellation
|
|
cancel context.CancelFunc // Cancel function for managing plugin lifecycle and cancellation
|
|
|
|
bus EventBus.Bus // Event bus for plugin events and RPC request/response dispatch
|
|
|
|
rpcMethods sync.Map // string -> *RpcMethod, registered JSON-RPC methods
|
|
|
|
socketsMu sync.RWMutex // mutex for gwsSockets map
|
|
sockets map[*gws.Conn]bool // tracked gws WebSocket connections (true: RPC server, false: regular)
|
|
}
|
|
|
|
func NewKernelPlugin(petal *model.Petal) *KernelPlugin {
|
|
token, err := model.CreatePluginJWT(petal.Name)
|
|
if err != nil {
|
|
logging.LogErrorf("Failed to create plugin JWT for [%s]: %v", petal.Name, err)
|
|
}
|
|
|
|
plugin := &KernelPlugin{
|
|
Petal: petal,
|
|
token: token,
|
|
file: fmt.Sprintf("%s/kernel.js", petal.Name),
|
|
|
|
bus: EventBus.New(),
|
|
|
|
sockets: make(map[*gws.Conn]bool),
|
|
}
|
|
|
|
plugin.state.Store(int64(PluginStateReady))
|
|
return plugin
|
|
}
|
|
|
|
// State returns the current plugin state (safe for concurrent reads).
|
|
func (p *KernelPlugin) State() PluginState {
|
|
return PluginState(p.state.Load())
|
|
}
|
|
|
|
// InitRuntime initializes the goja runtime and evaluates kernel.js.
|
|
func (p *KernelPlugin) InitRuntime() (err error) {
|
|
p.runtime = eventloop.NewEventLoop(eventloop.EnableConsole(true))
|
|
p.worker.Start(p.runtime)
|
|
|
|
p.runtime.Run(func(rt *goja.Runtime) {
|
|
defer func() {
|
|
if r := recover(); r != nil {
|
|
err = fmt.Errorf("goja panic during event loop run: %v", r)
|
|
}
|
|
}()
|
|
|
|
// Use JSON struct tags for field name mapping, with fallback to original names if "json" tag is absent.
|
|
rt.SetFieldNameMapper(goja.TagFieldNameMapper("json", true))
|
|
|
|
if enableErr := EnableExtendModules(p, rt); enableErr != nil {
|
|
err = fmt.Errorf("EnableExtendModules: %v", enableErr)
|
|
return
|
|
}
|
|
|
|
if enableErr := EnableSiyuanModule(p, rt); enableErr != nil {
|
|
err = fmt.Errorf("EnableSiyuanModule: %v", enableErr)
|
|
return
|
|
}
|
|
|
|
if _, runErr := rt.RunScript(p.file, p.Kernel.JS); runErr != nil {
|
|
err = fmt.Errorf("RunScript: %v", runErr)
|
|
return
|
|
}
|
|
})
|
|
p.runtime.Start()
|
|
return
|
|
}
|
|
|
|
// Eval evaluates JavaScript code in the plugin's goja runtime, returning the result or error.
|
|
func (p *KernelPlugin) Eval(rt *goja.Runtime, code string) (goja.Value, error) {
|
|
return rt.RunScript(p.file, code)
|
|
}
|
|
|
|
// close interrupts the goja runtime and clears the pointer.
|
|
func (p *KernelPlugin) close() (err error) {
|
|
defer func() {
|
|
if r := recover(); r != nil {
|
|
err = fmt.Errorf("goja panic during close runtime: %v", r)
|
|
}
|
|
}()
|
|
|
|
if p.runtime != nil {
|
|
p.runtime.Stop() // Stops the event loop and waits for it to finish.
|
|
// p.runtime.Terminate() // Interrupts the runtime and causes all executing code to throw an exception.
|
|
}
|
|
return
|
|
}
|
|
|
|
// error sets the plugin state to errored and frees the goja runtime.
|
|
func (p *KernelPlugin) error() {
|
|
if err := p.close(); err != nil {
|
|
logging.LogErrorf("[plugin:%s] failed to close runtime during error handling: %v", p.Name, err)
|
|
}
|
|
|
|
p.state.Store(int64(PluginStateError))
|
|
}
|
|
|
|
// start creates the goja runtime, injects sandbox globals, and evaluates kernel.js.
|
|
func (p *KernelPlugin) start() (err error) {
|
|
defer func() {
|
|
if r := recover(); r != nil {
|
|
p.error()
|
|
err = fmt.Errorf("goja panic during start: %v", r)
|
|
}
|
|
}()
|
|
|
|
p.state.Store(int64(PluginStateLoading))
|
|
p.context, p.cancel = context.WithCancel(context.Background())
|
|
|
|
baseDir := filepath.Join(util.DataDir, "storage", "petal", p.Name)
|
|
if err := os.MkdirAll(baseDir, 0755); err != nil {
|
|
return fmt.Errorf("create plugin dir [%s] failed: %s", baseDir, err)
|
|
}
|
|
|
|
if runtimeErr := p.InitRuntime(); runtimeErr != nil {
|
|
p.error()
|
|
return fmt.Errorf("start runtime: %v", runtimeErr)
|
|
}
|
|
|
|
if subscribeErr := p.subscribeEventHandlers(); subscribeErr != nil {
|
|
p.error()
|
|
return fmt.Errorf("subscribe plugin events: %v", subscribeErr)
|
|
}
|
|
|
|
p.onLoad()
|
|
p.state.Store(int64(PluginStateLoaded))
|
|
p.onLoaded()
|
|
p.state.Store(int64(PluginStateRunning))
|
|
p.onRunning()
|
|
|
|
p.bus.Publish(EventBusTopicRuntime, R{
|
|
"id": uuid.NewString(),
|
|
"type": "start",
|
|
})
|
|
|
|
logging.LogDebugf("[plugin:%s] started", p.Name)
|
|
return
|
|
}
|
|
|
|
// stop cleanly shuts down the plugin: closes sockets, frees goja runtime.
|
|
func (p *KernelPlugin) stop() (ok bool, err error) {
|
|
defer func() {
|
|
if r := recover(); r != nil {
|
|
p.error()
|
|
ok = false
|
|
err = fmt.Errorf("panic during plugin stop: %v", r)
|
|
}
|
|
}()
|
|
|
|
if p.State() != PluginStateRunning {
|
|
ok = false
|
|
return
|
|
}
|
|
|
|
p.bus.Publish(EventBusTopicRuntime, R{
|
|
"id": uuid.NewString(),
|
|
"type": "stop",
|
|
})
|
|
|
|
p.state.Store(int64(PluginStateStopping))
|
|
|
|
p.onUnload()
|
|
|
|
p.rpcMethods.Clear()
|
|
|
|
p.cancel()
|
|
|
|
p.socketsMu.Lock()
|
|
for c := range p.sockets {
|
|
delete(p.sockets, c)
|
|
}
|
|
p.socketsMu.Unlock()
|
|
|
|
p.unsubscribeEventHandlers()
|
|
|
|
p.close()
|
|
p.state.Store(int64(PluginStateStopped))
|
|
|
|
logging.LogDebugf("[plugin:%s] stopped", p.Name)
|
|
|
|
ok = true
|
|
return
|
|
}
|
|
|
|
// onLoad is called before plugin loaded.
|
|
func (p *KernelPlugin) onLoad() {
|
|
if p.State() == PluginStateLoading {
|
|
p.invokeHook("onload")
|
|
}
|
|
}
|
|
|
|
// onLoaded is called after plugin loaded.
|
|
func (p *KernelPlugin) onLoaded() {
|
|
if p.State() == PluginStateLoaded {
|
|
p.invokeHook("onloaded")
|
|
}
|
|
}
|
|
|
|
// onRunning is called after plugin running.
|
|
func (p *KernelPlugin) onRunning() {
|
|
if p.State() == PluginStateRunning {
|
|
p.invokeHook("onrunning")
|
|
}
|
|
}
|
|
|
|
// onUnload is called before plugin stop.
|
|
func (p *KernelPlugin) onUnload() {
|
|
if p.State() == PluginStateStopping {
|
|
p.invokeHook("onunload")
|
|
}
|
|
}
|
|
|
|
// bindRpcMethod add or updates a JS function as a named RPC method.
|
|
func (p *KernelPlugin) bindRpcMethod(name string, method goja.Callable, descriptions ...string) error {
|
|
p.rpcMethods.Store(name, &RpcMethod{
|
|
Name: name,
|
|
Descriptions: descriptions,
|
|
Method: method,
|
|
})
|
|
return nil
|
|
}
|
|
|
|
// unbindRpcMethod removes a registered RPC method
|
|
func (p *KernelPlugin) unbindRpcMethod(name string) error {
|
|
_, ok := p.rpcMethods.LoadAndDelete(name)
|
|
if !ok {
|
|
return nil
|
|
}
|
|
return nil
|
|
}
|
|
|
|
// runtimeEventHandler dispatches an event to the plugin's goja runtime
|
|
func (p *KernelPlugin) runtimeEventHandler(event any) {
|
|
p.worker.Run(func(rt *goja.Runtime) (result any, err error) {
|
|
return dispatchEvent(p, rt, event)
|
|
}, nil)
|
|
}
|
|
|
|
// pluginEventHandler handles events sent to the plugin
|
|
func (p *KernelPlugin) pluginEventHandler(event any) {
|
|
logging.LogDebugf("[plugin:%s] receive event: %#v", p.Name, event)
|
|
}
|
|
|
|
// subscribeEventHandlers subscribes to plugin lifecycle and RPC events, dispatching them to the plugin's JS runtime.
|
|
func (p *KernelPlugin) subscribeEventHandlers() (err error) {
|
|
defer func() {
|
|
if r := recover(); r != nil {
|
|
err = r.(error)
|
|
}
|
|
}()
|
|
|
|
lo.Must0(p.bus.Subscribe(EventBusTopicRuntime, p.runtimeEventHandler))
|
|
lo.Must0(p.bus.Subscribe(EventBusTopicPlugin, p.pluginEventHandler))
|
|
return
|
|
}
|
|
|
|
// unsubscribeEventHandlers unsubscribes from plugin events.
|
|
func (p *KernelPlugin) unsubscribeEventHandlers() (err error) {
|
|
defer func() {
|
|
if r := recover(); r != nil {
|
|
err = r.(error)
|
|
}
|
|
}()
|
|
|
|
lo.Must0(p.bus.Unsubscribe(EventBusTopicRuntime, p.runtimeEventHandler))
|
|
lo.Must0(p.bus.Unsubscribe(EventBusTopicPlugin, p.pluginEventHandler))
|
|
return
|
|
}
|
|
|
|
// GetRpcMethodsInfo returns a list of registered RPC methods with their descriptions.
|
|
func (p *KernelPlugin) GetRpcMethodsInfo() (methods []*RpcMethodInfo) {
|
|
p.rpcMethods.Range(func(name any, value any) bool {
|
|
if method, ok := value.(*RpcMethod); ok {
|
|
methods = append(methods, &RpcMethodInfo{
|
|
Name: method.Name,
|
|
Descriptions: method.Descriptions,
|
|
})
|
|
}
|
|
return true
|
|
})
|
|
return
|
|
}
|
|
|
|
// BroadcastNotification sends a JSON-RPC 2.0 notification to all inbound RPC WebSocket clients.
|
|
func (p *KernelPlugin) BroadcastNotification(method string, params util.Optional[any]) {
|
|
notification := JsonRpcRequest{
|
|
JsonRpc: JsonRpcVersion,
|
|
Method: method,
|
|
Params: params,
|
|
}
|
|
data, err := json.Marshal(notification)
|
|
if err != nil {
|
|
logging.LogWarnf("[plugin:%s] broadcast marshal: %s", p.Name, err)
|
|
return
|
|
}
|
|
|
|
p.socketsMu.RLock()
|
|
conns := make([]*gws.Conn, 0, len(p.sockets))
|
|
for conn, isRpcConnection := range p.sockets {
|
|
if isRpcConnection {
|
|
conns = append(conns, conn)
|
|
}
|
|
}
|
|
p.socketsMu.RUnlock()
|
|
|
|
var wg sync.WaitGroup
|
|
for _, conn := range conns {
|
|
wg.Add(1)
|
|
c := conn
|
|
payload := make([]byte, len(data))
|
|
copy(payload, data) // each conn needs its own copy; WriteAsync is async and all conns share the same source slice
|
|
c.WriteAsync(gws.OpcodeText, payload, func(writeErr error) {
|
|
defer wg.Done()
|
|
if writeErr != nil {
|
|
logging.LogWarnf("[plugin:%s] RPC WebSocket notification write failed: %s", p.Name, writeErr)
|
|
}
|
|
})
|
|
}
|
|
wg.Wait()
|
|
}
|
|
|
|
// dispatchRpcRequests dispatches multiple JSON-RPC requests concurrently.
|
|
// Returns responses in the same order as requests. Nil responses indicate notifications.
|
|
func (p *KernelPlugin) dispatchRpcRequests(requests []*JsonRpcProcessingRequest) []*JsonRpcProcessingResponse {
|
|
responses := make([]*JsonRpcProcessingResponse, len(requests))
|
|
var wg sync.WaitGroup
|
|
|
|
for i, request := range requests {
|
|
// For requests that failed JSON parsing or validation, return the error immediately without dispatching.
|
|
if request.Error != nil {
|
|
responses[i] = &JsonRpcProcessingResponse{Error: request.Error}
|
|
continue
|
|
}
|
|
|
|
// For notifications, dispatch without waiting for a response.
|
|
if request.Request.IsNotification() {
|
|
go func(request *JsonRpcRequest) {
|
|
p.dispatchRpcRequest(request)
|
|
}(request.Request)
|
|
responses[i] = nil
|
|
continue
|
|
}
|
|
|
|
if request.Request == nil {
|
|
responses[i] = nil
|
|
continue
|
|
}
|
|
|
|
// For normal requests, dispatch concurrently and collect responses.
|
|
wg.Add(1)
|
|
go func(index int, request *JsonRpcRequest) {
|
|
defer wg.Done()
|
|
responses[index] = p.dispatchRpcRequest(request)
|
|
}(i, request.Request)
|
|
}
|
|
|
|
wg.Wait()
|
|
return responses
|
|
}
|
|
|
|
// dispatchRpcRequest routes a single JSON-RPC request to the plugin's registered JS method.
|
|
// Returns nil for notifications (no ID field).
|
|
func (p *KernelPlugin) dispatchRpcRequest(request *JsonRpcRequest) *JsonRpcProcessingResponse {
|
|
// Validate request structure
|
|
if rpcError := request.Validate(); rpcError != nil {
|
|
// For notifications, return nil (no response).
|
|
if request.IsNotification() {
|
|
return nil
|
|
}
|
|
|
|
// For invalid requests, return error response.
|
|
return &JsonRpcProcessingResponse{
|
|
Error: &JsonRpcErrorResponse{
|
|
JsonRpc: JsonRpcVersion,
|
|
Error: rpcError,
|
|
ID: request.ID,
|
|
},
|
|
}
|
|
}
|
|
|
|
// For notifications, call the method without waiting for a response and return nil.
|
|
if request.IsNotification() {
|
|
go p.callRpcMethod(request.Method, request.Params.Value)
|
|
return nil
|
|
}
|
|
|
|
// For normal requests, call the method and return response or error.
|
|
rpcResult, rpcError := p.callRpcMethod(request.Method, request.Params.Value)
|
|
if rpcError == nil {
|
|
return &JsonRpcProcessingResponse{
|
|
Response: &JsonRpcRequestResponse{
|
|
JsonRpc: JsonRpcVersion,
|
|
Result: rpcResult,
|
|
ID: request.ID,
|
|
},
|
|
}
|
|
} else {
|
|
return &JsonRpcProcessingResponse{
|
|
Error: &JsonRpcErrorResponse{
|
|
JsonRpc: JsonRpcVersion,
|
|
Error: rpcError,
|
|
ID: request.ID,
|
|
},
|
|
}
|
|
}
|
|
}
|
|
|
|
// callRpcMethod invokes a registered JS RPC method via the event bus and awaits the response.
|
|
func (p *KernelPlugin) callRpcMethod(method string, params any) (rpcResult any, rpcError *JsonRpcError) {
|
|
defer func() {
|
|
if r := recover(); r != nil {
|
|
logging.LogDebugf("[plugin:%s] panic in RPC method [%s]: %v", p.Name, method, r)
|
|
rpcError = &JsonRpcError{
|
|
Code: JsonRpcErrorCodeInternalError,
|
|
Message: JsonRpcErrorInternalError.Message,
|
|
Data: fmt.Sprintf("goja panic in RPC method [%s]: %v", method, r),
|
|
}
|
|
}
|
|
}()
|
|
|
|
if p.State() != PluginStateRunning {
|
|
rpcError = &JsonRpcError{
|
|
Code: JsonRpcErrorCodeInternalError,
|
|
Message: JsonRpcErrorInternalError.Message,
|
|
Data: fmt.Sprintf("plugin [%s] not running (state: [%s])", p.Name, p.State()),
|
|
}
|
|
return
|
|
}
|
|
|
|
value, ok := p.rpcMethods.Load(method)
|
|
if !ok {
|
|
rpcError = &JsonRpcError{
|
|
Code: JsonRpcErrorCodeMethodNotFound,
|
|
Message: JsonRpcErrorMethodNotFound.Message,
|
|
Data: fmt.Sprintf("method [%s] not found in plugin [%s]", method, p.Name),
|
|
}
|
|
return
|
|
}
|
|
|
|
rpcMethod, ok := value.(*RpcMethod)
|
|
if !ok {
|
|
rpcError = &JsonRpcError{
|
|
Code: JsonRpcErrorCodeInternalError,
|
|
Message: JsonRpcErrorInternalError.Message,
|
|
Data: fmt.Sprintf("invalid method type for [%s]", method),
|
|
}
|
|
return
|
|
}
|
|
|
|
done := make(chan *TaskResult, 1)
|
|
|
|
p.worker.Run(func(rt *goja.Runtime) (result any, err error) {
|
|
rpcParams := []goja.Value{}
|
|
jsParams := rt.ToValue(params)
|
|
if isJsArray(rt, jsParams) {
|
|
// If params is an array, convert to []goja.Value for variadic JS function calls.
|
|
rt.ForOf(jsParams, func(cur goja.Value) bool {
|
|
rpcParams = append(rpcParams, cur)
|
|
return true
|
|
})
|
|
} else if !goja.IsUndefined(jsParams) && !goja.IsNull(jsParams) {
|
|
// If params is not an array but is defined, pass as single argument.
|
|
rpcParams = append(rpcParams, jsParams)
|
|
} else {
|
|
// If params is undefined or null, pass no arguments.
|
|
}
|
|
|
|
invokeFunction(func(_ *goja.Runtime, result *CallResult) {
|
|
done <- result.TaskResult()
|
|
}, rt, true, rpcMethod.Method, rt.GlobalObject(), rpcParams...)
|
|
return
|
|
}, nil)
|
|
|
|
result := <-done
|
|
if result.err != nil {
|
|
rpcError = &JsonRpcError{
|
|
Code: JsonRpcErrorCodeInternalError,
|
|
Message: JsonRpcErrorInternalError.Message,
|
|
Data: fmt.Sprintf("error invoking method %q: %v", method, result.err),
|
|
}
|
|
return
|
|
}
|
|
|
|
rpcResult = result.value
|
|
return
|
|
}
|
|
|
|
// TrackRpcSocket adds a RPC WebSocket connection to the plugin's tracked list.
|
|
func (p *KernelPlugin) TrackRpcSocket(conn *gws.Conn) {
|
|
if conn == nil {
|
|
return
|
|
}
|
|
p.socketsMu.Lock()
|
|
defer p.socketsMu.Unlock()
|
|
p.sockets[conn] = true
|
|
}
|
|
|
|
// UntrackRpcSocket removes a gws WebSocket connection from the plugin's tracked list.
|
|
func (p *KernelPlugin) UntrackRpcSocket(conn *gws.Conn) {
|
|
if conn == nil {
|
|
return
|
|
}
|
|
p.socketsMu.Lock()
|
|
defer p.socketsMu.Unlock()
|
|
delete(p.sockets, conn)
|
|
}
|
|
|
|
// invokeHook calls a lifecycle hook (e.g. onload) if it exists, awaiting if it returns a Promise.
|
|
func (p *KernelPlugin) invokeHook(name string) {
|
|
var err error
|
|
defer func() {
|
|
if r := recover(); r != nil {
|
|
err = fmt.Errorf("panic during lifecycle hook invocation: %v", r)
|
|
}
|
|
|
|
if err != nil {
|
|
logging.LogErrorf("[plugin:%s] lifecycle hook [%q] error: %v", p.Name, name, err)
|
|
}
|
|
}()
|
|
|
|
done := make(chan TaskResult, 1)
|
|
|
|
runErr := p.worker.Run(func(rt *goja.Runtime) (_ any, err error) {
|
|
lifecycle, err := getJsContextValue(rt, []any{"siyuan", "plugin", "lifecycle"})
|
|
if err != nil {
|
|
return
|
|
}
|
|
if lifecycle == nil {
|
|
err = fmt.Errorf("globalThis.siyuan.plugin.lifecycle not found")
|
|
return
|
|
}
|
|
|
|
pluginObj := lifecycle.ToObject(rt)
|
|
if pluginObj == nil {
|
|
err = fmt.Errorf("globalThis.siyuan.plugin.lifecycle is not an object")
|
|
return
|
|
}
|
|
|
|
hookValue := pluginObj.Get(name)
|
|
hook, ok := goja.AssertFunction(hookValue)
|
|
if !ok {
|
|
err = fmt.Errorf("globalThis.siyuan.plugin.lifecycle.%s not bound to a function", name)
|
|
return
|
|
}
|
|
|
|
invokeFunction(func(_ *goja.Runtime, result *CallResult) {
|
|
done <- *result.TaskResult()
|
|
}, rt, true, hook, lifecycle)
|
|
return
|
|
}, func(_ *goja.Runtime, _ any, err error) {
|
|
if err != nil {
|
|
done <- TaskResult{err: err}
|
|
}
|
|
})
|
|
if runErr != nil {
|
|
done <- TaskResult{err: runErr}
|
|
}
|
|
|
|
result := <-done
|
|
if result.err != nil {
|
|
err = result.err
|
|
}
|
|
}
|
|
|
|
// handleHttpRequest dispatches an HTTP request to the plugin's JS handler and returns the response.
|
|
func (p *KernelPlugin) handleHttpRequest(c *gin.Context, request *Request, scope AccessScope) (response *HttpResponse, err error) {
|
|
type handleResult FunctionResult[*HttpResponse]
|
|
done := make(chan *handleResult, 1)
|
|
|
|
runErr := p.worker.Run(func(rt *goja.Runtime) (_ any, err error) {
|
|
handler, handlerObj, getHandlerErr := getRequestHandler(rt, scope, RequestTypeHTTP)
|
|
if getHandlerErr != nil {
|
|
err = getHandlerErr
|
|
return
|
|
}
|
|
|
|
jsRequest, convertErr := requestGoToJs(p, rt, request)
|
|
if convertErr != nil {
|
|
err = convertErr
|
|
return
|
|
}
|
|
|
|
invokeFunction(func(rt *goja.Runtime, result *CallResult) {
|
|
if result.Error != nil {
|
|
done <- &handleResult{Error: result.Error}
|
|
return
|
|
}
|
|
|
|
responseObj := result.Value.ToObject(rt)
|
|
if responseObj == nil {
|
|
done <- &handleResult{Error: fmt.Errorf("handler did not return an object")}
|
|
return
|
|
}
|
|
|
|
// convert response.body?.raw?.data from (string | Buffer | ArrayBuffer) to []byte
|
|
var raw *[]byte
|
|
if bodyValue := responseObj.Get("body"); isJsValueNotNull(bodyValue) {
|
|
// response.body
|
|
if bodyObj := bodyValue.ToObject(rt); bodyObj != nil {
|
|
if rawValue := bodyObj.Get("raw"); isJsValueNotNull(rawValue) {
|
|
// response.body.raw
|
|
if rawObj := rawValue.ToObject(rt); rawObj != nil {
|
|
if dataValue := rawObj.Get("data"); isJsValueNotNull(dataValue) {
|
|
// response.body.raw.data
|
|
dataBytes, convertErr := jsValueToBytes(rt, dataValue)
|
|
if convertErr == nil {
|
|
raw = &dataBytes
|
|
rawObj.Set("data", goja.Null())
|
|
}
|
|
}
|
|
}
|
|
}
|
|
}
|
|
}
|
|
|
|
// ❌ panic: invalid memory address or nil pointer dereference
|
|
// response := HttpResponse{}
|
|
// if err := rt.ExportTo(responseObj, &response); err != nil {
|
|
// done <- &ServerHandlerResult{Error: fmt.Errorf("invalid response format: %v", err)}
|
|
// return
|
|
// }
|
|
|
|
resultJson, marshalErr := responseObj.MarshalJSON()
|
|
if marshalErr != nil {
|
|
done <- &handleResult{Error: marshalErr}
|
|
return
|
|
}
|
|
|
|
response := HttpResponse{}
|
|
if unmarshalErr := json.Unmarshal(resultJson, &response); unmarshalErr != nil {
|
|
done <- &handleResult{Error: fmt.Errorf("invalid response format: %v", unmarshalErr)}
|
|
return
|
|
}
|
|
|
|
if raw != nil && response.Body != nil && response.Body.Raw != nil {
|
|
response.Body.Raw.Data = *raw
|
|
}
|
|
|
|
done <- &handleResult{Value: &response}
|
|
}, rt, true, handler, handlerObj, jsRequest)
|
|
return
|
|
}, func(_ *goja.Runtime, _ any, err error) {
|
|
if err != nil {
|
|
done <- &handleResult{Error: err}
|
|
}
|
|
})
|
|
if runErr != nil {
|
|
done <- &handleResult{Error: runErr}
|
|
}
|
|
|
|
select {
|
|
case result := <-done:
|
|
if result.Error != nil {
|
|
err = result.Error
|
|
} else {
|
|
response = result.Value
|
|
}
|
|
case <-c.Request.Context().Done():
|
|
err = c.Request.Context().Err()
|
|
}
|
|
return
|
|
}
|
|
|
|
func (p *KernelPlugin) handleWebSocketRequest(c *gin.Context, request *Request, scope AccessScope) (err error) {
|
|
done := make(chan error, 1)
|
|
h := &WsEventHandler{p: p}
|
|
upgrader := gws.NewUpgrader(h, &gws.ServerOption{})
|
|
|
|
socket, upgradeErr := upgrader.Upgrade(c.Writer, c.Request)
|
|
if upgradeErr != nil {
|
|
err = upgradeErr
|
|
return
|
|
}
|
|
|
|
ctx, cancel := context.WithCancel(p.context)
|
|
|
|
var openOnce sync.Once
|
|
var closeOnce sync.Once
|
|
|
|
doOpen := func() {
|
|
go openOnce.Do(func() {
|
|
socket.ReadLoop()
|
|
cancel()
|
|
})
|
|
}
|
|
|
|
doClose := func() {
|
|
closeOnce.Do(func() {
|
|
socket.NetConn().Close()
|
|
cancel()
|
|
})
|
|
}
|
|
defer doClose()
|
|
|
|
var readyState atomic.Int64
|
|
var bufferedAmount atomic.Int64
|
|
readyState.Store(int64(WebSocketReadyStateConnecting))
|
|
|
|
runErr := p.worker.Run(func(rt *goja.Runtime) (_ any, err error) {
|
|
handler, handlerObj, getHandlerErr := getRequestHandler(rt, scope, RequestTypeWS)
|
|
if getHandlerErr != nil {
|
|
err = getHandlerErr
|
|
return
|
|
}
|
|
|
|
jsRequest, convertErr := requestGoToJs(p, rt, request)
|
|
if convertErr != nil {
|
|
err = convertErr
|
|
return
|
|
}
|
|
|
|
jsRequestObj := jsRequest.ToObject(rt)
|
|
if jsRequestObj == nil {
|
|
err = fmt.Errorf("failed to convert request value to object")
|
|
return
|
|
}
|
|
|
|
port := rt.NewObject()
|
|
|
|
invokePortHook := func(_ *goja.Runtime, name string, args ...goja.Value) {
|
|
hook := port.Get(name)
|
|
if fn, ok := goja.AssertFunction(hook); ok {
|
|
if _, callErr := fn(port, args...); callErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port hook %q: %v", p.Name, name, callErr)
|
|
}
|
|
}
|
|
}
|
|
|
|
setProtocol := func(rt *goja.Runtime, protocol string) {
|
|
port.Set("protocol", rt.ToValue(protocol))
|
|
}
|
|
|
|
setPortReadyState := func(rt *goja.Runtime, state WebSocketState) {
|
|
readyState.Store(int64(state))
|
|
port.Set("readyState", rt.ToValue(state))
|
|
}
|
|
|
|
updatePortBufferedAmount := func(rt *goja.Runtime, delta int) {
|
|
bufferedAmount.Add(int64(delta))
|
|
port.Set("bufferedAmount", rt.ToValue(bufferedAmount.Load()))
|
|
}
|
|
|
|
manager := &WsManager{
|
|
BufferedAmount: &bufferedAmount,
|
|
|
|
InvokeHook: invokePortHook,
|
|
SetProtocol: setProtocol,
|
|
SetReadyState: setPortReadyState,
|
|
}
|
|
|
|
h.BindOnOpen(manager)
|
|
h.BindOnClose(manager)
|
|
h.BindOnPing(manager)
|
|
h.BindOnPong(manager)
|
|
h.BindOnMessage(manager)
|
|
|
|
port_open := rt.ToValue(func(openCall goja.FunctionCall, rt *goja.Runtime) goja.Value {
|
|
openPromise, openResolve, openReject := rt.NewPromise()
|
|
|
|
openRunErr := p.worker.Run(func(rt *goja.Runtime) (_ any, _ error) {
|
|
doOpen()
|
|
return
|
|
}, func(rt *goja.Runtime, result any, err error) {
|
|
if lo.IsNil(err) {
|
|
if resolveErr := openResolve(result); resolveErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.open resolve: %v", p.Name, resolveErr)
|
|
}
|
|
} else {
|
|
if rejectErr := openReject(rt.NewGoError(err)); rejectErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.open reject: %v", p.Name, rejectErr)
|
|
}
|
|
}
|
|
})
|
|
if openRunErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.open worker run: %v", p.Name, openRunErr)
|
|
}
|
|
|
|
return rt.ToValue(openPromise)
|
|
})
|
|
|
|
port_send := rt.ToValue(func(sendCall goja.FunctionCall, rt *goja.Runtime) goja.Value {
|
|
sendPromise, sendResolve, sendReject := rt.NewPromise()
|
|
|
|
sendRunErr := p.worker.Run(func(rt *goja.Runtime) (_ any, err error) {
|
|
var messageData []byte
|
|
var opcode gws.Opcode
|
|
if len(sendCall.Arguments) >= 1 {
|
|
data := sendCall.Argument(0)
|
|
if arrayBuffer, ok := data.Export().(goja.ArrayBuffer); ok {
|
|
opcode = gws.OpcodeBinary
|
|
b := arrayBuffer.Bytes()
|
|
messageData = make([]byte, len(b))
|
|
copy(messageData, b) // ArrayBuffer.Bytes() points into JS engine memory; copy before async send
|
|
} else {
|
|
opcode = gws.OpcodeText
|
|
messageData = []byte(data.String())
|
|
}
|
|
}
|
|
|
|
state := WebSocketState(readyState.Load())
|
|
if state == WebSocketReadyStateClosing || state == WebSocketReadyStateClosed {
|
|
err = fmt.Errorf("WebSocket is not open (state: %d)", state)
|
|
return
|
|
}
|
|
|
|
updatePortBufferedAmount(rt, len(messageData))
|
|
socket.WriteAsync(opcode, messageData, func(writeErr error) {
|
|
p.worker.Run(func(rt *goja.Runtime) (_ any, err error) {
|
|
if writeErr == nil {
|
|
updatePortBufferedAmount(rt, -len(messageData))
|
|
} else {
|
|
err = writeErr
|
|
}
|
|
return
|
|
}, func(rt *goja.Runtime, result any, err error) {
|
|
if lo.IsNil(err) {
|
|
if resolveErr := sendResolve(result); resolveErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.send resolve: %v", p.Name, resolveErr)
|
|
}
|
|
} else {
|
|
if rejectErr := sendReject(rt.NewGoError(err)); rejectErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.send reject: %v", p.Name, rejectErr)
|
|
}
|
|
}
|
|
})
|
|
})
|
|
return
|
|
}, func(rt *goja.Runtime, _ any, err error) {
|
|
if !lo.IsNil(err) {
|
|
if rejectErr := sendReject(rt.NewGoError(err)); rejectErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.send reject: %v", p.Name, rejectErr)
|
|
}
|
|
}
|
|
})
|
|
if sendRunErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.send worker run: %v", p.Name, sendRunErr)
|
|
}
|
|
|
|
return rt.ToValue(sendPromise)
|
|
})
|
|
|
|
port_ping := rt.ToValue(func(pingCall goja.FunctionCall, rt *goja.Runtime) goja.Value {
|
|
pingPromise, pingResolve, pingReject := rt.NewPromise()
|
|
|
|
pingRunErr := p.worker.Run(func(rt *goja.Runtime) (result any, err error) {
|
|
var pingData string
|
|
if len(pingCall.Arguments) > 0 && !goja.IsUndefined(pingCall.Argument(0)) {
|
|
pingData = pingCall.Argument(0).String()
|
|
}
|
|
err = socket.WritePing([]byte(pingData))
|
|
return
|
|
}, func(rt *goja.Runtime, result any, err error) {
|
|
if lo.IsNil(err) {
|
|
if resolveErr := pingResolve(result); resolveErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.ping resolve: %v", p.Name, resolveErr)
|
|
}
|
|
} else {
|
|
if rejectErr := pingReject(rt.NewGoError(err)); rejectErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.ping reject: %v", p.Name, rejectErr)
|
|
}
|
|
}
|
|
})
|
|
if pingRunErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.ping worker run: %v", p.Name, pingRunErr)
|
|
}
|
|
|
|
return rt.ToValue(pingPromise)
|
|
})
|
|
|
|
port_pong := rt.ToValue(func(pongCall goja.FunctionCall, rt *goja.Runtime) goja.Value {
|
|
pongPromise, pongResolve, pongReject := rt.NewPromise()
|
|
|
|
pongRunErr := p.worker.Run(func(rt *goja.Runtime) (result any, err error) {
|
|
var pongData string
|
|
if len(pongCall.Arguments) > 0 && !goja.IsUndefined(pongCall.Argument(0)) {
|
|
pongData = pongCall.Argument(0).String()
|
|
}
|
|
err = socket.WritePong([]byte(pongData))
|
|
return
|
|
}, func(rt *goja.Runtime, result any, err error) {
|
|
if lo.IsNil(err) {
|
|
if resolveErr := pongResolve(result); resolveErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.pong resolve: %v", p.Name, resolveErr)
|
|
}
|
|
} else {
|
|
if rejectErr := pongReject(rt.NewGoError(err)); rejectErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.pong reject: %v", p.Name, rejectErr)
|
|
}
|
|
}
|
|
})
|
|
if pongRunErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.pong worker run: %v", p.Name, pongRunErr)
|
|
}
|
|
|
|
return rt.ToValue(pongPromise)
|
|
})
|
|
|
|
port_close := rt.ToValue(func(closeCall goja.FunctionCall, rt *goja.Runtime) goja.Value {
|
|
closePromise, closeResolve, closeReject := rt.NewPromise()
|
|
|
|
closeRunErr := p.worker.Run(func(rt *goja.Runtime) (result any, err error) {
|
|
code := uint16(1000)
|
|
var reason []byte
|
|
if isJsValueNotNull(closeCall.Argument(0)) {
|
|
code = uint16(closeCall.Argument(0).ToInteger())
|
|
}
|
|
if isJsValueNotNull(closeCall.Argument(1)) {
|
|
reason = []byte(closeCall.Argument(1).String())
|
|
}
|
|
setPortReadyState(rt, WebSocketReadyStateClosing)
|
|
err = socket.WriteClose(code, reason)
|
|
return
|
|
}, func(rt *goja.Runtime, result any, err error) {
|
|
if lo.IsNil(err) {
|
|
if resolveErr := closeResolve(result); resolveErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.close resolve: %v", p.Name, resolveErr)
|
|
}
|
|
} else {
|
|
if rejectErr := closeReject(rt.NewGoError(err)); rejectErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.close reject: %v", p.Name, rejectErr)
|
|
}
|
|
}
|
|
})
|
|
if closeRunErr != nil {
|
|
logging.LogErrorf("[plugin:%s] ws server port.close worker run: %v", p.Name, closeRunErr)
|
|
}
|
|
|
|
return rt.ToValue(closePromise)
|
|
})
|
|
|
|
lo.Must0(port.Set("binaryType", rt.ToValue("arraybuffer")))
|
|
lo.Must0(port.Set("bufferedAmount", rt.ToValue(bufferedAmount.Load())))
|
|
lo.Must0(port.Set("protocol", rt.ToValue("")))
|
|
lo.Must0(port.Set("readyState", rt.ToValue(readyState.Load())))
|
|
|
|
lo.Must0(port.Set("onopen", goja.Null()))
|
|
lo.Must0(port.Set("onmessage", goja.Null()))
|
|
lo.Must0(port.Set("onping", goja.Null()))
|
|
lo.Must0(port.Set("onpong", goja.Null()))
|
|
lo.Must0(port.Set("onclose", goja.Null()))
|
|
lo.Must0(port.Set("onerror", goja.Null()))
|
|
|
|
lo.Must0(port.Set("open", port_open))
|
|
lo.Must0(port.Set("send", port_send))
|
|
lo.Must0(port.Set("ping", port_ping))
|
|
lo.Must0(port.Set("pong", port_pong))
|
|
lo.Must0(port.Set("close", port_close))
|
|
|
|
lo.Must0(ObjectSeal(rt, port))
|
|
lo.Must0(jsRequestObj.Set("port", port))
|
|
|
|
invokeFunction(func(_ *goja.Runtime, result *CallResult) {
|
|
if result.Error != nil {
|
|
// If the handler throws an error, close the connection and return the error.
|
|
select {
|
|
case done <- result.Error:
|
|
case <-ctx.Done():
|
|
}
|
|
return
|
|
}
|
|
// Auto-open if the handler did not call port.open() explicitly.
|
|
doOpen()
|
|
}, rt, true, handler, handlerObj, jsRequest)
|
|
|
|
return
|
|
}, func(_ *goja.Runtime, _ any, err error) {
|
|
if err != nil {
|
|
// If there is an error during the worker run (e.g. runtime panic), close the connection and return the error.
|
|
select {
|
|
case done <- err:
|
|
case <-ctx.Done():
|
|
}
|
|
}
|
|
})
|
|
if runErr != nil {
|
|
select {
|
|
case done <- runErr:
|
|
case <-ctx.Done():
|
|
}
|
|
}
|
|
|
|
select {
|
|
case err = <-done:
|
|
case <-ctx.Done():
|
|
}
|
|
return
|
|
}
|
|
|
|
// handleServerSentEventRequest dispatches an SSE request to the plugin's JS handler and streams events until completion or client disconnect.
|
|
func (p *KernelPlugin) handleServerSentEventRequest(c *gin.Context, request *Request, scope AccessScope) (err error) {
|
|
type sseEvent struct {
|
|
name string
|
|
message any
|
|
}
|
|
|
|
ctx, cancel := context.WithCancel(p.context)
|
|
|
|
var closeOnce sync.Once
|
|
doClose := func() {
|
|
closeOnce.Do(func() {
|
|
cancel()
|
|
})
|
|
}
|
|
defer doClose()
|
|
|
|
events := chanx.NewUnboundedChan[sseEvent](ctx, 16)
|
|
done := make(chan error, 1) // using to receive handler error or close signal
|
|
|
|
runErr := p.worker.Run(func(rt *goja.Runtime) (_ any, err error) {
|
|
handler, handlerObj, getHandlerErr := getRequestHandler(rt, scope, RequestTypeSSE)
|
|
if getHandlerErr != nil {
|
|
err = getHandlerErr
|
|
return
|
|
}
|
|
|
|
jsRequest, convertErr := requestGoToJs(p, rt, request)
|
|
if convertErr != nil {
|
|
err = convertErr
|
|
return
|
|
}
|
|
|
|
jsRequestObj := jsRequest.ToObject(rt)
|
|
if jsRequestObj == nil {
|
|
err = fmt.Errorf("failed to convert request value to object")
|
|
return
|
|
}
|
|
|
|
port := rt.NewObject()
|
|
|
|
invokePortHook := func(name string, args ...goja.Value) {
|
|
hook := port.Get(name)
|
|
if fn, ok := goja.AssertFunction(hook); ok {
|
|
if _, callErr := fn(port, args...); callErr != nil {
|
|
logging.LogErrorf("[plugin:%s] sse server port hook %q: %v", p.Name, name, callErr)
|
|
}
|
|
}
|
|
}
|
|
|
|
port_send := rt.ToValue(func(call goja.FunctionCall, rt *goja.Runtime) goja.Value {
|
|
name := call.Argument(0).String()
|
|
message := call.Argument(1).Export()
|
|
events.In <- sseEvent{name, message}
|
|
return goja.Undefined()
|
|
})
|
|
|
|
port_close := rt.ToValue(func(call goja.FunctionCall, rt *goja.Runtime) goja.Value {
|
|
doClose()
|
|
return goja.Undefined()
|
|
})
|
|
|
|
lo.Must0(port.Set("onopen", goja.Null()))
|
|
lo.Must0(port.Set("onclose", goja.Null()))
|
|
|
|
lo.Must0(port.Set("send", port_send))
|
|
lo.Must0(port.Set("close", port_close))
|
|
|
|
lo.Must0(ObjectSeal(rt, port))
|
|
|
|
lo.Must0(jsRequestObj.Set("port", port))
|
|
|
|
invokeFunction(func(_ *goja.Runtime, result *CallResult) {
|
|
if result.Error != nil {
|
|
select {
|
|
case done <- result.Error:
|
|
case <-ctx.Done():
|
|
}
|
|
return
|
|
}
|
|
// Only start the onclose goroutine when the handler succeeds, so that
|
|
// onclose is never dispatched without a prior onopen.
|
|
go func() {
|
|
<-ctx.Done()
|
|
p.worker.Run(func(rt *goja.Runtime) (_ any, _ error) {
|
|
event := rt.NewObject()
|
|
event.Set("type", rt.ToValue("close"))
|
|
invokePortHook("onclose", event)
|
|
return
|
|
}, nil)
|
|
}()
|
|
|
|
// Fire onopen first; signal done only after onopen has executed so that
|
|
// any port.send() calls inside onopen are enqueued before streaming begins.
|
|
p.worker.Run(func(rt *goja.Runtime) (_ any, _ error) {
|
|
event := rt.NewObject()
|
|
event.Set("type", rt.ToValue("open"))
|
|
invokePortHook("onopen", event)
|
|
return
|
|
}, func(_ *goja.Runtime, _ any, err error) {
|
|
select {
|
|
case done <- err:
|
|
case <-ctx.Done():
|
|
}
|
|
})
|
|
}, rt, true, handler, handlerObj, jsRequest)
|
|
|
|
return
|
|
}, func(_ *goja.Runtime, _ any, err error) {
|
|
if err != nil {
|
|
select {
|
|
case done <- err:
|
|
case <-ctx.Done():
|
|
}
|
|
}
|
|
})
|
|
if runErr != nil {
|
|
select {
|
|
case done <- runErr:
|
|
case <-ctx.Done():
|
|
}
|
|
}
|
|
|
|
for {
|
|
select {
|
|
case e := <-events.Out:
|
|
c.SSEvent(e.name, e.message)
|
|
c.Writer.Flush()
|
|
case <-ctx.Done():
|
|
return
|
|
case <-c.Request.Context().Done():
|
|
err = c.Request.Context().Err()
|
|
return
|
|
case handlerErr := <-done:
|
|
if handlerErr != nil {
|
|
err = handlerErr
|
|
return
|
|
}
|
|
// Handler completed successfully; keep streaming until port.close() or client disconnect.
|
|
}
|
|
}
|
|
}
|