source context
378e51ec 1014 441f Be28 B68581d5cdd0
ctx:claims/beam/378e51ec-1014-441f-be28-b68581d5cdd0Source document
full textbeam-chunk
text/plain1 KB
doc:beam/378e51ec-1014-441f-be28-b68581d5cdd0def forward(self, x): x = self.embedding(x) x = self.fc1(x) x = self.relu(x) x = self.dropout(x) x = self.fc2(x) return x class CustomDataset(Dataset): def __init__(self, data, labels): self.data = data self.labels = labels def __len__(self): return len(self.data) def __getitem__(self, idx): return self.data[idx], self.labels[idx] # Example data data = torch.randint(0, 1000, (1000,)) labels = torch.randint(0, 10, (1000,)) dataset = CustomDataset(data, labels) dataloader = DataLoader(dataset, batch_size=32, shuffle=True, num_workers=4) model = LanguageEmbeddingModel(vocab_size=1000, embedding_dim=128, hidden_dim=64, output_dim= 10) criterion = nn.CrossEntropyLoss() optimizer = optim.Adam(model.parameters(), lr=0.001) scheduler = optim.lr_scheduler.ReduceLROnPlateau(optimizer, 'min') device = torch.device("cuda" if torch.cuda.is_available() else "cpu") model.to(device) writer = SummaryWriter() num_epochs = 10 for epoch in range(num_epochs): running_loss = 0.0 model.train() for i, (inputs, labels) in enumerate(dataloader):
Facts in this context
Grouped by subject. Each subject links to its full article.
Data Loader8 factsex:DataLoader
| hasParameter | batch_size |
| hasParameter | shuffle |
| hasParameter | num_workers |
| hasParameterValue | 4 |
| hasParameterValue | 32 |
| hasParameterValue | true |
| instantiatesWith | Dataset |
| rdf:type | Py Torch Data Loader |
Forward8 factsex:forward
| calls | Fc2 |
| calls | Dropout |
| calls | Fc1 |
| calls | Relu |
| calls | Embedding |
| hasParameter | x |
| rdf:type | Py Torch Method |
| returns | x |
Training Process8 factsex:training_process
| includes | Batch Processing |
| includes | Epoch Loop |
| rdf:type | Machine Learning Training |
| uses | Criterion |
| uses | Model |
| uses | Dataloader |
| uses | Optimizer |
| uses | Scheduler |
Forward Pass6 factsex:forward_pass
| rdf:type | Neural Network Operation |
| sequence | Fc2 Call |
| sequence | Embedding Call |
| sequence | Fc1 Call |
| sequence | Dropout Call |
| sequence | Relu Call |
Language Embedding Model6 factsex:LanguageEmbeddingModel
| hasParameter | vocab_size |
| hasParameter | embedding_dim |
| hasParameter | hidden_dim |
| hasParameter | output_dim |
| instantiatesWith | Model |
| rdf:type | Py Torch Module |
Custom Dataset5 factsex:CustomDataset
| hasMethod | Init |
| hasMethod | Getitem |
| hasMethod | Len |
| inheritsFrom | Dataset |
| rdf:type | Py Torch Dataset |
Labels4 factsex:labels
| createdBy | Torch Randint |
| hasArgument | 0 |
| hasArgument | 10 |
| rdf:type | Torch Tensor |
Scheduler4 factsex:scheduler
| hasParameter | mode |
| hasParameterValue | min |
| instantiatesWith | Optim Lr Scheduler Reduce Lr on Plateau |
| rdf:type | Py Torch Scheduler |
Batch Iteration3 factsex:batch_iteration
| unpacks | inputs |
| unpacks | labels |
| uses | Enumerate |
Dataset3 factsex:dataset
| instantiatesWith | Labels |
| instantiatesWith | Data |
| rdf:type | Custom Dataset |
Torch Randint3 factsex:torch_randint
| hasArgument | 0 |
| hasArgument | [1000,] |
| hasArgument | 1000 |
Training Loop3 factsex:training_loop
| contains | Batch Iteration |
| iteratesOver | Range Num Epochs |
| rdf:type | Epoch Iteration |
Criterion2 factsex:criterion
| instantiatesWith | Nn Cross Entropy Loss |
| rdf:type | Py Torch Loss Function |
Data2 factsex:data
| createdBy | Torch Randint |
| rdf:type | Torch Tensor |
Dataloader2 factsex:dataloader
| createdFrom | Dataset |
| rdf:type | Data Loader |
Device2 factsex:device
| determinationLogic | Cuda Availability Check |
| rdf:type | Torch Device |
Getitem2 factsex:__getitem__
| hasParameter | idx |
| returns | Data and Labels Tuple |
Init2 factsex:__init__
| hasParameter | data |
| hasParameter | labels |
Num Epochs2 factsex:num_epochs
| hasValue | 10 |
| rdf:type | Training Parameter |
Optim Adam2 factsex:optim_Adam
| hasParameter | lr |
| hasParameterValue | 0.001 |
Optimizer2 factsex:optimizer
| instantiatesWith | Optim Adam |
| rdf:type | Py Torch Optimizer |
Running Loss2 factsex:running_loss
| initializedAt | 0 |
| rdf:type | Training Metric |
Summary Writer2 factsex:SummaryWriter
| instantiates | Writer |
| rdf:type | Tensor Board Writer |
Dropout1 factex:dropout
| rdf:type | Py Torch Regularization Layer |
Embedding1 factex:embedding
| rdf:type | Py Torch Layer |
Ex:dropout Call1 factex:ex:dropout_call
| precedes | Fc2 Call |
Ex:embedding Call1 factex:ex:embedding_call
| precedes | Fc1 Call |
Ex:fc1 Call1 factex:ex:fc1_call
| precedes | Relu Call |
Ex:relu Call1 factex:ex:relu_call
| precedes | Dropout Call |
Fc11 factex:fc1
| rdf:type | Py Torch Linear Layer |
Fc21 factex:fc2
| rdf:type | Py Torch Linear Layer |
Len1 factex:__len__
| returns | Length of Data |
Relu1 factex:relu
| rdf:type | Py Torch Activation Function |