GPU COMPUTE / IN DETAIL7 useful answers
Which OmbraHost GPU configurations are prepared?+
The Spectre range lists an RTX 4090 with 24 GB VRAM, RTX A6000 with 48 GB and H100 with 80 GB. Model weights, context cache, batch size and software overhead all affect fit. Locations and images vary by tier. Installed models, measured token rates and GPU allocation require a provisioning integration.
How much GPU memory is needed?+
FP16 weights need roughly two bytes per parameter; four-bit weights roughly half a byte. Allow additional room for context cache, batching and runtime overhead.
What are the GPU choices?+
Spectre 4090 specifies 24 GB VRAM, A6000 48 GB and H100 80 GB. Benchmark the actual model and precision before choosing.
Will a 70B FP16 model fit?+
Its weights alone need roughly 140 GB. A single 80 GB H100 cannot hold them; evaluate quantisation or a suitable multi-GPU configuration.
Can I request multiple GPUs?+
Custom multi-GPU arrangements are a prepared sales enquiry. Stock, NVLink topology, power and lead time must be confirmed before any commitment.
Are short research bursts available?+
The source describes a seven-day minimum by arrangement. This remains a proposed commercial option; the current checkout uses the three published billing cycles.
Can Windows be used?+
Only the catalogue templates appear in the standard selector. Windows GPU or custom image requests require driver, licence and deployment eligibility checks.
A little more flexibility.
PREPARED OPTIONSExplore optional services and their billing units. Optional service requests require a connected provider before fulfilment.
Veil Edge
Prepared network profile with the 10 Gbps mitigation allocation, anomaly detection and latency tuning. Validate its relationship to protection already included in the plan.
$4.75per month
Eclipse Shield
Prepared 100 Gbps profile with application rules and a dedicated filtering path. Confirm effective capacity and compatibility; some base plans already specify greater capacity.
$19.00per month
Iron Veil
An engineer-led baseline review covering CIS guidance, login protection, key handling and firewall rules. This service is prepared and has no assigned engineer yet.
$46.55one-time
Vault Mirror
Prepared daily incremental off-site copies, seven-day retention and an encrypted S3-compatible destination. The destination and recovery procedure require production validation.
$4.75per month
Checkpoint
Prepared scheduled and manual snapshots with a rolling five-snapshot retention limit. This fixed service fee is separate from the proposed per-GB storage fee.
$2.85per month
First Light
A proposed initial setup covering installation, security baseline and agreed basic services. The one-time scope must be confirmed before work begins.
$19.00one-time
Shadow Transfer
A prepared transfer service included at no charge with an eligible new order. Inventory, access, cutover and rollback are agreed before migration.
$0.00one-time
Route Extension
One additional IPv4 address, subject to allocation eligibility and technical approval. Selecting the option does not reserve or route an address.
$1.90per month