## Paper Review: Do Adversarially Robust ImageNet Models Transfer Better?

Paper Link: https://arxiv.org/abs/2007.08489
Contribution
Authors identified that adversarial robustness affects transfer learning performance.
Despite being less accurate on ImageNet, adversarially robust neural networks match or improve on the transfer performance of their standard counterparts.
They establish this trend in both “fixed-f...

## Awesome Python

1. “and” and “or” returns the object
>>> [] and {}
[] # what???
Python’s “and” operation and “or” operation doesn’t returns “True” or “False”.
A or B # is equal to
A if A is True else B
# and also
A and B # is equal to
A if A is False else B
Note that neither and nor or restrict the value and type they return to False and True,...

## Entropy, Cross-Entropy, KL-Divergence

Entropy (at Information theory)
The expectation of bits that used for notating (or classify each other) probabilistic events when using optimal bits coding scheme. (\(log_2(\frac{1}{p})\) bits for notating events)
Entropy also can be interpreted as the average rate at which information is produced by stochastic source of data. (rare events...

## What is Logit and Logistic?

In Math
If $p$ is probability..
odds is $\frac{p}{1-p}$.
The logit (logistic unit) function or the log-odds is $logit(p) = \log \frac{p}{1-p}$ in statistics.
Logit function makes a map of probability values from $(0, 1)$ to $(-\infty, +\infty)$.
The logistic function or the sigmoid function is the inverse-logit. ($log...

## CVPR 2020 Tutorial: Interpretable Machine Learning for Computer Vision

website: https://interpretablevision.github.io/
Lecture 1 by Bolei Zhou: Exploring and Exploiting Interpretable Semantics in GANs. video, slide, bili
Lecture 2 by Zeynep Akata: Modeling Conceptual Understanding in Image Reference Games video, slide, bili
Lecture 3 by Ruth C. Fong: Understanding Deep Neural Networks video, slide, bili
Lecture...

## Paper Review: IMAGENET-TRAINED CNNS ARE BIASED TOWARDS TEXTURE

Paper Link: https://openreview.net/forum?id=Bygh9j09KX
Abstract
ImageNet-trained CNNs are strongly biased towards recognising textures rather than shapes, which is in stark contrast to human behavioural evidence and reveals fundamentally different classification strategies.Authors then demonstrate that the same standard architecture (ResNet-...

## Paper Review: A Character-Aware Neural Network for Distorted Scene Text Recognition (Char-Net)

Paper Link: http://www.visionlab.cs.hku.hk/publications/wliu_aaai18.pdf
Contributions
simple and efficient Char-Net for distorted scene text recognition. This network can be trained in end-to-end using only text images and their corresponding character labels.
Hierarchical Attention Mechanism (HAM) that facilitates the rectification of in...

## PC에서 1.1.1.1 warp사용하기

최근 해외 트래픽(트위터, 넷플릭스, 유튜브, 깃헙 등등) 사용 시 느려지는 문제를 해결하기 위해서 1.1.1.1 warp를 사용하시는 분들이 많습니다. 그런데 아직 1.1.1.1은 스마트폰에서만 지원하기 때문에 PC에서는 1.1.1.1을 사용을 못하고 계실텐데 최근에 사용할 수 있는 방법을 찾게되어 이를 알려드립니다.
과정은 다음과 같습니다.
wireguard를 설치합니다. (https://www.wireguard.com/install/) 여기에서 OS에 맞게 설치하시면 됩니다.
wgcf를 다운로드 합니다. (https://github.com/ViRb3/wgcf/releases) 윈도우 64비트의 경...

23 post articles, 3 pages.