You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# Mambular: Tabular Deep Learning with Mamba Architectures
18
+
<h1>Mambular: Tabular Deep Learning with Mamba</h1>
19
19
20
-
You can find our paper `Mambular: A Sequential Model for Tabular Deep Learning`[here](https://arxiv.org/abs/2408.06291).
20
+
Mambular is a Python library for tabular deep learning. It includes models that leverage the Mamba (State Space Model) architecture, as well as other popular models like TabTransformer, FTTransformer, and tabular ResNets. Check out our paper `Mambular: A Sequential Model for Tabular Deep Learning`, available[here](https://arxiv.org/abs/2408.06291).
21
21
22
-
# Table of Contents
23
-
-[Mambular: Tabular Deep Learning with Mamba Architectures](#mambular-tabular-deep-learning-with-mamba-architectures)
24
-
-[Table of Contents](#table-of-contents)
25
-
-[Introduction](#introduction)
22
+
<h3> Table of Contents </h3>
23
+
24
+
-[Introduction](#introduction)
26
25
-[Features](#features)
27
-
-[Models](#models)
28
-
-[Results](#results)
29
-
-[Documentation](#documentation)
30
-
-[Installation](#installation)
26
+
-[Models](#models)
27
+
-[Results](#results)
28
+
-[Documentation](#documentation)
29
+
-[Installation](#installation)
31
30
-[Usage](#usage)
32
31
-[Preprocessing](#preprocessing)
33
32
-[Data Type Detection and Transformation](#data-type-detection-and-transformation)
@@ -37,13 +36,13 @@ You can find our paper `Mambular: A Sequential Model for Tabular Deep Learning`
37
36
-[Key Features of MambularLSS:](#key-features-of-mambularlss)
38
37
-[Available Distribution Classes:](#available-distribution-classes)
39
38
-[Getting Started with MambularLSS:](#getting-started-with-mambularlss)
40
-
-[Implement Your Own Model](#implement-your-own-model)
41
-
-[Citation](#citation)
42
-
-[License](#license)
39
+
-[Implement Your Own Model](#implement-your-own-model)
40
+
-[Citation](#citation)
41
+
-[License](#license)
43
42
44
43
45
44
46
-
##Introduction
45
+
# Introduction
47
46
Mambular is a Python package that brings the power of advanced deep learning architectures to tabular data, offering a suite of models for regression, classification, and distributional regression tasks. Designed with ease of use in mind, Mambular models adhere to scikit-learn's `BaseEstimator` interface, making them highly compatible with the familiar scikit-learn ecosystem. This means you can fit, predict, and evaluate using Mambular models just as you would with any traditional scikit-learn model, but with the added performance and flexibility of deep learning.
48
47
49
48
## Features
@@ -56,7 +55,7 @@ Mambular is a Python package that brings the power of advanced deep learning arc
56
55
-**PyTorch Lightning Under the Hood**: Built on top of PyTorch Lightning, Mambular models benefit from streamlined training processes, easy customization, and advanced features like distributed training and 16-bit precision.
@@ -73,7 +72,7 @@ All models are available for `regression`, `classification` and distributional r
73
72
Hence, they are available as e.g. `MambularRegressor`, `MambularClassifier` or `MambularLSS`
74
73
75
74
76
-
##Results
75
+
# Results
77
76
Detailed results for the available methods can be found [here](https://arxiv.org/abs/2408.06291).
78
77
Note, that these are achieved results with default hyperparameter and for our splits. Performing hyperparameter optimization could improve the performance of all models.
79
78
@@ -130,11 +129,11 @@ The average rank table over all models and all datasets is given here:
130
129
131
130
132
131
133
-
##Documentation
132
+
# Documentation
134
133
135
134
You can find the Mamba-Tabular API documentation [here](https://mambular.readthedocs.io/en/latest/).
136
135
137
-
##Installation
136
+
# Installation
138
137
139
138
Install Mambular using pip:
140
139
```sh
@@ -253,7 +252,7 @@ model.fit(
253
252
```
254
253
255
254
256
-
###Implement Your Own Model
255
+
# Implement Your Own Model
257
256
258
257
Mambular allows users to easily integrate their custom models into the existing logic. This process is designed to be straightforward, making it simple to create a PyTorch model and define its forward pass. Instead of inheriting from `nn.Module`, you inherit from Mambular's `BaseModel`. Each Mambular model takes three main arguments: the number of classes (e.g., 1 for regression or 2 for binary classification), `cat_feature_info`, and `num_feature_info` for categorical and numerical feature information, respectively. Additionally, you can provide a config argument, which can either be a custom configuration or one of the provided default configs.
0 commit comments