Model

Properties

Name	Type	Description	Notes
schema	EmbeddedModelSchema		[optional]
id	String	uuid
version	String	this is a version of the model.
created	GroupedTimestamp
name	String	This is an Optional Name of the Model.
description	String	An Optional Description of the model itself.	[optional]
cloud	bool	This will inform the user if this was a model that is hosted in the cloud
type	ModelTypeEnum
usage	ModelUsageEnum
bytes	ByteDescriptor		[optional]
ram	ByteDescriptor		[optional]
quantization	String	quantization is a string like: q8f16_0, q4f16_1, etc...	[optional]
foundation	ModelFoundationEnum		[optional]
downloaded	bool	This is an optional bool to let us know if this model has been downloaded locally.	[optional]
loaded	bool	This is a boolean that represents if the model is loaded into memory.(this is not persisted, and is calculated on the fly.)	[optional]
unique	String	This is the unique model name used to load the model.	[optional]
parameters	num	This is the number of parameters in terms of billions.	[optional]
provider	ExternalMLProviderEnum		[optional]
cpu	bool	This is an optional bool that is optimized for CPU usage.	[optional]
downloading	bool	This is a calculated property, that will say if this is currently downloading.	[optional]
maxTokens	ModelMaxTokens		[optional]
custom	bool		[optional]