Yh" d dl Z d dlZd dlZd dlmZ d dlmZ d dlmZ d dl m
Z
m Z m Z d dl
Z
ddlmZ ddlmZmZmZ d d
d d Zd
Z G d de Zd de eef de e deeeef ee f fdZde eef dededdfdZ d de eef de e ddfdZ d de eef de e deddfdZ d de eef de e de ee deddf
d Z dS ) N)Iterator)contextmanager)Path)AnyOptionalUnion ) ImageFolder)check_integrityextract_archiveverify_str_arg)zILSVRC2012_img_train.tar 1d675b47d978889d74fa0da5fadfb00e)zILSVRC2012_img_val.tar 29b22e2961454d5413ddabcf34fc5622)z ILSVRC2012_devkit_t12.tar.gz fa75699e90414af021442c21a62c3abf)trainvaldevkitzmeta.binc v e Zd ZdZd deeef dededdf fd
Zd
d Z e
defd
Z defd Z xZ
S )ImageNeta< `ImageNet `_ 2012 Classification Dataset.
.. note::
Before using this class, it is required to download ImageNet 2012 dataset from
`here `_ and
place the files ``ILSVRC2012_devkit_t12.tar.gz`` and ``ILSVRC2012_img_train.tar``
or ``ILSVRC2012_img_val.tar`` based on ``split`` in the root directory.
Args:
root (str or ``pathlib.Path``): Root directory of the ImageNet Dataset.
split (string, optional): The dataset split, supports ``train``, or ``val``.
transform (callable, optional): A function/transform that takes in a PIL image or torch.Tensor, depends on the given loader,
and returns a transformed version. E.g, ``transforms.RandomCrop``
target_transform (callable, optional): A function/transform that takes in the
target and transforms it.
loader (callable, optional): A function to load an image given its path.
By default, it uses PIL as its image loader, but users could also pass in
``torchvision.io.decode_image`` for decoding image data into tensors directly.
Attributes:
classes (list): List of the class name tuples.
class_to_idx (dict): Dict with items (class_name, class_index).
wnids (list): List of the WordNet IDs.
wnid_to_idx (dict): Dict with items (wordnet_id, class_index).
imgs (list): List of (image path, class_index) tuples
targets (list): The class_index value for each image in the dataset
r rootsplitkwargsreturnNc t j | x}| _ t |dd | _ | t | j d t j | j
fi | || _ | j | _ | j
| _ fd| j D | _ d t | j D | _
d S )Nr )r r r c g | ]
}| S r ).0wnidwnid_to_classess o/var/www/tools.fuzzalab.pt/emblema-extractor/venv/lib/python3.11/site-packages/torchvision/datasets/imagenet.py
z%ImageNet.__init__..@ s EEE$-EEE c $ i | ]
\ }}|D ]}||S r r )r idxclssclss r
z%ImageNet.__init__..A s- _ _ _)#tZ^ _ _SVS# _ _ _ _r" )ospath
expanduserr r
r parse_archivesload_meta_filesuper__init__ split_folderclasseswnids class_to_idx wnid_to_idx enumerate)selfr r r r __class__s @r r. zImageNet.__init__4 s 7--d333ty#E74DEE
(33A6*55f555 \
,EEEE$*EEE _ _y 7N7N _ _ _r" c l t t j | j t
st
| j t j | j sB| j dk rt | j d S | j dk rt | j d S d S d S )Nr r ) r r( r) joinr META_FILEparse_devkit_archiveisdirr/ r parse_train_archiveparse_val_archiver5 s r r+ zImageNet.parse_archivesC s rw||DIy A ABB , + + +w}}T .// -zW$$#DI.....u$$!$),,,,, - - %$r" c V t j | j | j S N)r( r) r8 r r r> s r r/ zImageNet.split_folderM s w||DItz222r" c & dj di | j S )NzSplit: {split}r )format__dict__r> s r
extra_reprzImageNet.extra_reprQ s & &77 777r" )r )r N)__name__
__module__ __qualname____doc__r strr r r. r+ propertyr/ rD
__classcell__)r6 s @r r r s 8
`
`U39 -
`c
`s
`W[
`
`
`
`
`
` - - - - 3c 3 3 3 X38C 8 8 8 8 8 8 8 8r" r r filer c |t }t j | | }t | rt j |d S d}t | || )NT) weights_onlyzThe meta file {} is not present in the root directory or is corrupted. This file is automatically created by the ImageNet dataset.) r9 r( r) r8 r torchload RuntimeErrorrB )r rL msgs r r, r, U so |
7<<d # #Dt 3z$T2222
J 3::dD11222r" md5c t t j | | | s%d}t | || d S )Nz{The archive {} is not present in the root directory or is corrupted. You need to download it externally and place it in {}.)r r( r) r8 rQ rB )r rL rS rR s r _verify_archiverU d sW 27<<d33S 9 9 3
E 3::dD11222 3 3r" c
H
ddl m
dt dt t t
t f t t t t df f f f
fd }dt dt t
fd}t dt t fd }t d }||d }|d
}t | || | 5 }t t j
| | | t j
|d } || \ } || }
fd |
D } t j | | ft j
| t" ddd dS # 1 swxY w Y dS )
aI Parse the devkit archive of the ImageNet2012 classification dataset and save
the meta information in a binary file.
Args:
root (str or ``pathlib.Path``): Root directory containing the devkit archive
file (str, optional): Name of devkit archive. Defaults to
'ILSVRC2012_devkit_t12.tar.gz'
r N devkit_rootr .c t j | dd } |d d t t d }fdt
| D t t d d \ }}}d |D }d
t || D }d t || D }||fS ) Ndatazmeta.matT)
squeeze_mesynsets c 2 g | ]\ }}|d k | S )r r )r r$ num_childrenmetas r r! z@parse_devkit_archive..parse_meta_mat..| s- aaa /c<|_`O`O`S O`O`O`r" c R g | ]$}t | d %S )z, )tupler )r r% s r r! z@parse_devkit_archive..parse_meta_mat..~ s, ???t5D))**???r" c i | ]\ }}|| S r r )r r$ r s r r' z@parse_devkit_archive..parse_meta_mat.. s CCCYS$sDCCCr" c i | ]\ }}|| S r r )r r r% s r r' z@parse_devkit_archive..parse_meta_mat.. s LLL*$4LLLr" )r( r) r8 loadmatlistzipr4 )
rW metafile
nums_childrenidcsr1 r0 idx_to_wnidr r_ sios
@r parse_meta_matz,parse_devkit_archive..parse_meta_matx s 7<< VZ@@{{8{55i@ S$Z((+
aaaa9]3K3Kaaa #CJ / / 3 eW??w???CC#dE2B2BCCC LLE78K8KLLLO++r" c t j | dd }t | 5 }| }d d d n # 1 swxY w Y d |D S )NrY z&ILSVRC2012_validation_ground_truth.txtc , g | ]}t | S r )int)r val_idxs r r! zKparse_devkit_archive..parse_val_groundtruth_txt.. s 555G 555r" )r( r) r8 open readlines)rW rL txtfhval_idcss r parse_val_groundtruth_txtz7parse_devkit_archive..parse_val_groundtruth_txt s w||K1YZZ
$ZZ )5 ((H ) ) ) ) ) ) ) ) ) ) ) ) ) ) )55H5555s AAAc 3 K t j } | V t j | d S # t j | w xY wr@ )tempfilemkdtempshutilrmtree)tmp_dirs r get_tmp_dirz)parse_devkit_archive..get_tmp_dir sN "$$ #MMM M' " " " " "FM' " " " "s 1 Ar r ILSVRC2012_devkit_t12c g | ]
}| S r r )r r$ rk s r r! z(parse_devkit_archive.. s :::#[%:::r" )scipy.ioiorI rb dictrp rf r r ARCHIVE_METArU r r( r) r8 rO saver9 )r rL rm rv r} archive_metarS r| rW r ru val_wnidsrk rl s @@r r: r: m s ,C ,E$sCx.$sERUWZRZOG[B\2\,] , , , , , ,6s 6tCy 6 6 6 6 ## # # # ^# )L |A
q/CD$$$$ P' T400':::gll7,CDD '5~k'B'B$ _,,[99:::::::
OY/ dI1N1NOOOP P P P P P P P P P P P P P P P P Ps B0FF Fr folderc t d }||d }|d }t | || t j | | t t j | | fdt j D }|D ]7}t |t j | d d 8dS )a Parse the train images archive of the ImageNet2012 classification dataset and
prepare it for usage with the ImageNet dataset.
Args:
root (str or ``pathlib.Path``): Root directory containing the train images archive
file (str, optional): Name of train images archive. Defaults to
'ILSVRC2012_img_train.tar'
folder (str, optional): Optional name for train images folder. Defaults to
'train'
r Nr r c P g | ]"}t j | #S r r( r) r8 )r archive
train_roots r r! z'parse_train_archive.. s) XXXg Z11XXXr" T)remove_finished)r rU r( r) r8 r listdirsplitext)r rL r r rS archivesr r s @r r< r< s (L |A
q/CD$$$$ dF++JBGLLt,,j999XXXXJAWAWXXXH U U!1!1'!:!:1!=tTTTTTU Ur" r r1 c t d }||d }|d }|t | d }t | || t j | | t
t j | | t fdt j D }t | D ]4}t j
t j | 5t || D ]V\ }}t j
|t j |t j | WdS )az Parse the validation images archive of the ImageNet2012 classification dataset
and prepare it for usage with the ImageNet dataset.
Args:
root (str or ``pathlib.Path``): Root directory containing the validation images archive
file (str, optional): Name of validation images archive. Defaults to
'ILSVRC2012_img_val.tar'
wnids (list, optional): List of WordNet IDs of the validation images. If None
is given, the IDs are loaded from the meta file in the root directory
folder (str, optional): Optional name for validation images folder. Defaults to
'val'
r Nr r c 3 X K | ]$}t j | V %d S r@ r )r imageval_roots r z$parse_val_archive.. s3 TTeBGLL511TTTTTTr" )r r, rU r( r) r8 r sortedr setmkdirrg rz movebasename)
r rL r1 r r rS imagesr img_filer s
@r r= r= sJ &L |A
q/C } t$$Q'D$$$$w||D&))HBGLLt,,h777
TTTTrz(?S?STTT
T
TFE
/ /
h--.... eV,, X Xh Hbgll8T27;K;KH;U;U V VWWWWX Xr" r@ )Nr )NNr ) r( rz rx collections.abcr
contextlibr pathlibr typingr r r rO r r
utilsr r r
r r9 r rI rb r rf r, rU r: r< r= r r" r r s
$ $ $ $ $ $ % % % % % % ' ' ' ' ' ' ' ' ' ' C C C C C C C C C C N IR
;8 ;8 ;8 ;8 ;8{ ;8 ;8 ;8| 3 3sDy) 3# 3%PTUXZ]U]P^`deh`iPiJj 3 3 3 3 3%T * 3# 3C 3D 3 3 3 33P 3PuS$Y / 3Px} 3PPT 3P 3P 3P 3PlU UeCI . Uhsm UTW Ufj U U U U6 jo!X !X
T
!X"*3-!X?GS ?R!Xcf!X !X !X !X !X !X !Xr"