VLsI: Verbalized Layers-to-Interactions from Large to Small Vision Language Models
Paper
•
2412.01822
•
Published
•
14
Integrated Vision and Language Lab.
university
AI & ML interests
Deep learning and machine learning on computer vision and multimedia, Multimodal deep learning, Integrating vision, speech, and language for AI, Multimodal object and motion detection/recognition, Inclusive human machine teaming, Analysis for competency, interpretability, memorability, and robustness of deep learning model, Multimodal prompt with large scale model
Recent Activity
View all activity
ivyivl's activity
dwightro
authored
2
papers
about 2 months ago
dwightro
authored
a
paper
7 months ago
dwightro
authored
a
paper
8 months ago
dwightro
authored
10
papers
10 months ago
Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing
Paper
•
2402.15151
•
Published
•
7
Masking Adversarial Damage: Finding Adversarial Saliency for Robust and Sparse Network
Paper
•
2204.02738
•
Published
•
3
Distilling Robust and Non-Robust Features in Adversarial Examples by Information Bottleneck
Paper
•
2204.02735
•
Published
•
4
CoLLaVO: Crayon Large Language and Vision mOdel
Paper
•
2402.11248
•
Published
•
21
Demystifying Causal Features on Adversarial Examples and Causal Inoculation for Robust Network by Adversarial Instrumental Variable Regression
Paper
•
2303.01052
•
Published
•
3
Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge
Paper
•
2308.09311
•
Published
•
1
DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embedding
Paper
•
2308.07787
•
Published
•
1
Causal Unsupervised Semantic Segmentation
Paper
•
2310.07379
•
Published
•
3
MoAI: Mixture of All Intelligence for Large Language and Vision Models
Paper
•
2403.07508
•
Published
•
75
Mitigating Adversarial Vulnerability through Causal Parameter Estimation by Adversarial Double Machine Learning
Paper
•
2307.07250
•
Published
•
2