Tag: Deep learning

Artificial intelligence (ai)

Visual language understanding and generation expected to be hot in 2022: one-click image annotation generation, visual q&A, open source code, official Demo playable

February 2, 2024

by 葛雅琪

No Comments

2022 expected to be hot visual language understanding and generation: one-click generated image annotation, visual q&A, open source code, official Demo playable, ARTIFICIAL intelligence YYDS

Read More

Artificial intelligence (ai)

Prompt. A lazier way than an AutoPrompt is toPrompt

February 2, 2024

by Tracy Cooper

No Comments

This is the third part of the Prompt series. Prompt Prompts Prompts. Prompt Prompts Prompts. Prompt Prompts prompt prompt Prompts.

Read More

Artificial intelligence (ai)

[PaperRead]Fully Convolutional Networks for Panoptic Segmentation

February 2, 2024

by Ishaan Vyas

No Comments

It is the first time to use full convolutional network to carry out the pioneering work of panorama segmentation and propose a simple, powerful and...

Read More

Artificial intelligence (ai)

[BaseLearn] Understand SoftMax+ cross entropy

February 2, 2024

by Lindsay Smith

No Comments

The basic knowledge of classification task -- Softmax and cross entropy loss function, this paper will introduce Softmax and cross entropy loss function from multiple...

Read More

Artificial intelligence (ai)

(1) Introduction: New paradigm of NLP? Pre-trained new pet Prompt has ignition

February 2, 2024

by Eshani Sule

No Comments

Prompt, as a new paradigm in THE field of NLP, has become a hot topic in NLP research in recent months. This article is the...

Read More

Artificial intelligence (ai)

[Prompt series] (2) [Paper sharing] AutoPrompt: Do not blindly design, laborious but thankless

February 2, 2024

by Hazel Sanghvi

No Comments

This is the second part of the Prompt series. In the last issue, some introductory knowledge of Prompt was introduced. In this issue, a classic...

Read More

Artificial intelligence (ai)

Hyperpartitioned reconstructed dataset DIV2K & Flickr2K

February 2, 2024

by Kaitlyn Chandler-Monk

No Comments

For regular SR training, we would need to download X2, X3, X4, X8 as well as the original train and Valid

Read More

Artificial intelligence (ai)

Explain the principle of Softmax and its relationship with cross entropy loss in detail

February 2, 2024

by John Armstrong

No Comments

Softmax definition The Chinese name for Softmax is exponential normalization, often used in multi-classification models. Many students are confused about the principle of Softmax. This...

Read More

Artificial intelligence (ai)

Pre-trained Prompt Tuning: This is a PPT from Tsinghua University

February 2, 2024

by Steven Smith

No Comments

This paper is the fourth part of Prompt series. It explores design ideas and innovates training strategies. It is the work of well-known teams such...

Read More

Artificial intelligence (ai)

PSNR and SSIM calculation for Hyperfractional Reconstruction (PyTorch Implementation)

February 2, 2024

by Mr. Maurice Page

No Comments

In image processing, what algorithms can be used to compare the similarity of two images? In the field of computer vision, PSNR and SSIM are...

Read More

Artificial intelligence (ai)

An article will make clear the differences and connections between artificial intelligence, machine learning and deep learning

February 2, 2024

by Kashvi Sane

No Comments

The wave of Artificial Intelligence is sweeping the world, and many words are always in our ears: Artificial Intelligence, Machine Learning, Deep Learning. Many people...

Read More

Artificial intelligence (ai)

Model parallel distributed training Megatron (4) — How to set up various parallelism

February 2, 2024

by 楊怡伶

No Comments

Megatron is a PyTorch based distributed training framework for training large Transformer language models. It uses data parallelism, Tensor parallelism and Pipeline parallelism to replicate...

Read More

Artificial intelligence (ai)

Communication primitives for distributed training

February 2, 2024

by Nicola Brookes-Williams

No Comments

In deep learning framework, the communication primitives and communication implementation methods of distributed training play a very important role in distributed training of AI framework....

Read More

Artificial intelligence (ai)

Interview | Thomson, head of the HPC wen-zhi liu Chen (wind) : two future strategic direction and hiring four standards

February 2, 2024

by Roy Hughes

No Comments

Sensetime recently completed a $410 million Series B funding round, the largest ever in ai. According to insiders in the industry, on the one hand,...

Read More

Artificial intelligence (ai)

Tensorflow project exercise: CNN image captcha recognition

February 2, 2024

by Sherry Mullins

No Comments

Introduction: I learned some basic knowledge of machine learning and deep learning, and had a simple understanding of Tensorflow framework. I wanted to do a...

Read More

Artificial intelligence (ai)

Model parallel distributed training Megatron (2) — Overall architecture

February 2, 2024

by Kayla Long

No Comments

NVIDIA Megatron is a PyTorch based distributed training framework used to train large Transformer language models. It recreates GPT by combining data parallelism, Tensor parallelism...

Read More

Artificial intelligence (ai)

Model Parallel Distributed Training Megatron (1) — Thesis & Foundation

February 2, 2024

by Dishani Gandhi

No Comments

Megatron is a PyTorch based distributed training framework for training large Transformer language models. It uses data parallelism, Tensor parallelism and Pipeline parallelism to replicate...

Read More

Artificial intelligence (ai)

Model parallel distributed training Megatron (3) — Model parallel implementation

February 2, 2024

by Ralph Ball

No Comments

NVIDIA Megatron is a PyTorch based distributed training framework for training large Transformer models. It uses data parallelism, Tensor parallelism and Pipeline parallelism to replicate...

Read More

Artificial intelligence (ai)

Bit Main SE5 edge box Caffe SSD quantization and transformation deployment model

February 2, 2024

by Christopher Marsh

No Comments

Hi, I'm Jizhi Vision. This paper describes in detail the method of quantifying and transforming the deployment model of caffe SSD detection on a Bitmain...

Read More

The code of life

Still wasting your time learning greedy algorithms? Three reasons you don’t need to learn greedy algorithms!

February 2, 2024

by Abram Chad

No Comments

Column website www.jiuzhang.com | | nine chapters algorithm many classmate ask me: why does not contain the greedy algorithm in the course, whether can be...

Read More

Artificial intelligence (ai)

Conditional random fields implement named entity recognition

February 2, 2024

by Emma Booth

No Comments

NLP is called by many people as the pearl in the crown of artificial intelligence, which shows its importance in the FIELD of AI, and...

Read More

Artificial intelligence (ai)

【 Model reasoning 】 Understand winograd convolution acceleration algorithm

February 2, 2024

by Ritvik Sule

No Comments

Hi, I'm Jizhi Vision. This paper explains in detail the implementation principle of Winograd algorithm accelerated convolution. I've already written a couple of articles on...

Read More

Artificial intelligence (ai)

PyTorch-11 will perform a Neural style tutorial on neural style transfer

February 2, 2024

by Jasmine Simmons

No Comments

This tutorial describes how to implement a Neural-Style algorithm developed by Leon A.Gatys. Neural-style, or neural-Transfer, allows you to take a new artistic Style of...

Read More

Artificial intelligence (ai)

Incorporating Global Visual Features into attention-based NMT

February 2, 2024

by Akarsh Ahluwalia

No Comments

This article was published in ACL in 2017. Lead author Calixto is from the ADAPT Centre at Dublin City University and is currently an assistant...

Read More

Artificial intelligence (ai)

【 thesis Notes 】Attention-based Multimodal Neural Machine Translation

February 2, 2024

by Nakul Sarin

No Comments

This article is a Shared Task paper for WMT 2016. Po-yao Huang is the first author from CMU and currently works at FAIR LABS.

Read More

Artificial intelligence (ai)

PyTorch-10 Spatial Transformer Tutorial (STN

February 2, 2024

by 羅雅萍

No Comments

In this tutorial, you will learn how to enhance your network using a visual attention mechanism called spatial converter network. You can read more about...

Read More

Artificial intelligence (ai)

Key -Attentive Decoder: A classic of multimodal attention

February 2, 2024

by Dr. Nicholas Gonzalez

No Comments

Tsinghua NLP machine translation 30 years of the most important papers reading list works! Published in ACL 2017, first author Calixto is from the ADAPT...

Read More

Artificial intelligence (ai)

A record of building Tensorflow in Windows10 environment

February 2, 2024

by 蘇佳玲

No Comments

This article recorded a Windows10 environment on the construction of Tensorflow process, in the Win10 environment can also carry out deep learning.

Read More

The front end

Tik Tok reveals the secret behind AR props for Spring Festival

February 2, 2024

by Ms. Sandra Henderson

No Comments

As the Spring Festival of 2022 approaches, Tiktok has officially launched the Warm China Year campaign. In order to increase the online atmosphere of the...

Read More

Artificial intelligence (ai)

Quick start framework, from zero reproducing paper – model paper

February 2, 2024

by Rebecca Harmon

No Comments

Last, this paper will introduce RepVGG model retrieval process, retrieval code is open source, https://github.com/Asthestarsfalll/RepVGG-MegEngine.

Read More