๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

๐Ÿ‘ฉ‍๐Ÿ’ป11

[์ฝ”๋“œ ๋ฆฌ๋ทฐ] ๋…ธ๋…„์ธต ๋Œ€ํ™” ๊ฐ์„ฑ ๋ถ„๋ฅ˜ ๋ชจ๋ธ ๊ตฌํ˜„ (3): Transformer โ‘  ๊ฐ์„ฑ ๋ถ„๋ฅ˜ ๋ชจ๋ธ ๊ตฌํ˜„ ์‹œ๋ฆฌ์ฆˆ (1) | CNN ๊ฐ์„ฑ ๋ถ„๋ฅ˜ ๋ชจ๋ธ ๊ตฌํ˜„ ์‹œ๋ฆฌ์ฆˆ (2) | RNN Transformer ๋ถ„๋ฅ˜ ๋ชจ๋ธ์€ ๋‹จ์ผ ํŒŒ์ผ์ด ์•„๋‹ˆ๋ผ์„œ ํ•˜๋‚˜์”ฉ ๋ถ„์„ํ•˜๋ฉด ๊ธ€์ด 3๊ฐœ๋‚˜ 4๊ฐœ ์ •๋„ ๋‚˜์˜ฌ ๊ฒƒ ๊ฐ™๋‹ค. ๐Ÿ‘ฉ‍๐Ÿซ ๋ชจ๋ธ ํด๋ž˜์Šค import torch import torch.nn as nn import torch.nn.functional as F from copy import deepcopy from .encoder import Encoder, EncoderLayer from .sublayers import * attn = MultiHeadAttention(8, 152) ff = PositionwiseFeedForward(152, 1024, 0.5) pe = PositionalEncoding(152, 0.5).. 2022. 12. 27.
[์ฝ”๋“œ ๋ฆฌ๋ทฐ] ๋…ธ๋…„์ธต ๋Œ€ํ™” ๊ฐ์„ฑ ๋ถ„๋ฅ˜ ๋ชจ๋ธ ๊ตฌํ˜„ (2) : RNN ๊ฐ์„ฑ ๋ถ„๋ฅ˜ ๋ชจ๋ธ ๊ตฌํ˜„ ์‹œ๋ฆฌ์ฆˆ (1) | CNN ๐Ÿ‘ฉ‍๐Ÿซ ๋ชจ๋ธ ํด๋ž˜์Šค class RNN(nn.Module): def __init__(self, vocab_size, embed_dim, hidden_dim, n_layers, dropout, num_class, device): super(RNN, self).__init__() self.device = device self.n_layers = n_layers self.hidden_dim = hidden_dim self.embed = nn.Embedding(vocab_size, embed_dim) self.dropout = nn.Dropout(p=dropout) self.gru = nn.GRU(embed_dim, self.hidden_dim, self.n_laye.. 2022. 12. 21.
[์ฝ”๋“œ ๋ฆฌ๋ทฐ] ๋…ธ๋…„์ธต ๋Œ€ํ™” ๊ฐ์„ฑ ๋ถ„๋ฅ˜ ๋ชจ๋ธ ๊ตฌํ˜„ (1) : CNN ์ด๋ฒˆ ํ•™๊ธฐ ํ•˜๋‚˜ ์žˆ๋˜ ํ…€ํ”„๋กœ์ ํŠธ๊ฐ€ ๋๋‚œ ํ›„ ์‚ฌ์šฉํ•œ ์ฝ”๋“œ์— ๋Œ€ํ•ด ๋ณต์Šต ๋ชฉ์ ์œผ๋กœ ๊ธ€์„ ์ž‘์„ฑํ•œ๋‹ค. ๋ชจ๋ธ์€ ์ด 3๊ฐœ์ธ๋ฐ CNN, RNN, Transformer ์ˆœ์œผ๋กœ ์ •๋ฆฌํ•  ์˜ˆ์ •์ด๋‹ค. ๐Ÿ‘ฉ‍๐Ÿซ ๋ชจ๋ธ ํด๋ž˜์Šค class CNN(nn.Module): def __init__(self, vocab_size, embed_dim, n_filters, filter_size, dropout, num_class): super(CNN, self).__init__() self.embedding = nn.Embedding(vocab_size, embed_dim) self.conv1d_layers = nn.ModuleList([nn.Conv1d(in_channels=embed_dim, out_channels=n_filters[i], ke.. 2022. 12. 13.
[ART] attack_adversarial_patch_TensorFlowV2.ipynb ์ฝ”๋“œ ๋ถ„์„ jupyter notebook์œผ๋กœ ์ฝ”๋“œ ๋Œ๋ฆฌ๋Š”๋ฐ ์งœ์ž˜ํ•œ ์—๋Ÿฌ๊ฐ€ ์ž๊พธ ๋– ์„œ ์˜ค๋Š˜์€ ์‚ฝ์งˆ ์ข€ ํ–ˆ๋‹ค ๐Ÿ˜ข โœ… ์ฝ”๋“œ ์›๋ณธ : https://github.com/Trusted-AI/adversarial-robustness-toolbox/blob/main/art/attacks/evasion/adversarial_patch/adversarial_patch.py GitHub - Trusted-AI/adversarial-robustness-toolbox: Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning S Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning.. 2022. 1. 19.
[ART] attack_defence_imagenet.ipynb ์ฝ”๋“œ ์‹ค์Šต ์›๋ณธ ์ฝ”๋“œ๋ฅผ ๋Œ๋ ค๋ณด๊ณ  ๋๋‚ด๋Š” ๊ฒƒ์ด ์•„๋‹ˆ๋ผ attack/defence์— ๋Œ€ํ•œ ์ฝ”๋“œ๋ฅผ ์กฐ๊ธˆ์”ฉ ๋ฐ”๊ฟ”๋ณด๋ฉด์„œ ์‹ค์Šต์„ ์ง„ํ–‰ํ–ˆ๋‹ค. โœ… ์ฝ”๋“œ ์›๋ณธ : https://github.com/Trusted-AI/adversarial-robustness-toolbox/blob/main/notebooks/attack_defence_imagenet.ipynb GitHub - Trusted-AI/adversarial-robustness-toolbox: Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning S Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Securit.. 2022. 1. 18.
[ART] adversarial_training_mnist.ipynb ์ฝ”๋“œ ๋ถ„์„ โœ… ์ฝ”๋“œ : https://github.com/Trusted-AI/adversarial-robustness-toolbox/blob/main/notebooks/adversarial_training_mnist.ipynb GitHub - Trusted-AI/adversarial-robustness-toolbox: Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning S Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams.. 2022. 1. 12.