1_Preliminaries.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Computer Vision Nanodegree\n",
    "\n",
    "## Project: Image Captioning\n",
    "\n",
    "---\n",
    "\n",
    "In this notebook, you will learn how to load and pre-process data from the [COCO dataset](http://cocodataset.org/#home). You will also design a CNN-RNN model for automatically generating image captions.\n",
    "\n",
    "Note that **any amendments that you make to this notebook will not be graded**.  However, you will use the instructions provided in **Step 3** and **Step 4** to implement your own CNN encoder and RNN decoder by making amendments to the **models.py** file provided as part of this project.  Your **models.py** file **will be graded**. \n",
    "\n",
    "Feel free to use the links below to navigate the notebook:\n",
    "- [Step 1](#step1): Explore the Data Loader\n",
    "- [Step 2](#step2): Use the Data Loader to Obtain Batches\n",
    "- [Step 3](#step3): Experiment with the CNN Encoder\n",
    "- [Step 4](#step4): Implement the RNN Decoder"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id='step1'></a>\n",
    "## Step 1: Explore the Data Loader\n",
    "\n",
    "We have already written a [data loader](http://pytorch.org/docs/master/data.html#torch.utils.data.DataLoader) that you can use to load the COCO dataset in batches. \n",
    "\n",
    "In the code cell below, you will initialize the data loader by using the `get_loader` function in **data_loader.py**.  \n",
    "\n",
    "> For this project, you are not permitted to change the **data_loader.py** file, which must be used as-is.\n",
    "\n",
    "The `get_loader` function takes as input a number of arguments that can be explored in **data_loader.py**.  Take the time to explore these arguments now by opening **data_loader.py** in a new window.  Most of the arguments must be left at their default values, and you are only allowed to amend the values of the arguments below:\n",
    "1. **`transform`** - an [image transform](http://pytorch.org/docs/master/torchvision/transforms.html) specifying how to pre-process the images and convert them to PyTorch tensors before using them as input to the CNN encoder.  For now, you are encouraged to keep the transform as provided in `transform_train`.  You will have the opportunity later to choose your own image transform to pre-process the COCO images.\n",
    "2. **`mode`** - one of `'train'` (loads the training data in batches) or `'test'` (for the test data). We will say that the data loader is in training or test mode, respectively.  While following the instructions in this notebook, please keep the data loader in training mode by setting `mode='train'`.\n",
    "3. **`batch_size`** - determines the batch size.  When training the model, this is number of image-caption pairs used to amend the model weights in each training step.\n",
    "4. **`vocab_threshold`** - the total number of times that a word must appear in the in the training captions before it is used as part of the vocabulary.  Words that have fewer than `vocab_threshold` occurrences in the training captions are considered unknown words. \n",
    "5. **`vocab_from_file`** - a Boolean that decides whether to load the vocabulary from file.  \n",
    "\n",
    "We will describe the `vocab_threshold` and `vocab_from_file` arguments in more detail soon.  For now, run the code cell below.  Be patient - it may take a couple of minutes to run!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Requirement already satisfied: nltk in /opt/conda/lib/python3.6/site-packages (3.2.5)\n",
      "Requirement already satisfied: six in /opt/conda/lib/python3.6/site-packages (from nltk) (1.11.0)\n",
      "[nltk_data] Downloading package punkt to /root/nltk_data...\n",
      "[nltk_data]   Unzipping tokenizers/punkt.zip.\n",
      "loading annotations into memory...\n",
      "Done (t=1.18s)\n",
      "creating index...\n",
      "index created!\n",
      "[0/414113] Tokenizing captions...\n",
      "[100000/414113] Tokenizing captions...\n",
      "[200000/414113] Tokenizing captions...\n",
      "[300000/414113] Tokenizing captions...\n",
      "[400000/414113] Tokenizing captions...\n",
      "loading annotations into memory...\n",
      "Done (t=0.93s)\n",
      "creating index...\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "  0%|          | 919/414113 [00:00<01:28, 4647.30it/s]"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "index created!\n",
      "Obtaining caption lengths...\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "100%|██████████| 414113/414113 [01:30<00:00, 4566.30it/s]\n"
     ]
    }
   ],
   "source": [
    "import sys\n",
    "sys.path.append('/opt/cocoapi/PythonAPI')\n",
    "from pycocotools.coco import COCO\n",
    "!pip install nltk\n",
    "import nltk\n",
    "nltk.download('punkt')\n",
    "from data_loader import get_loader\n",
    "from torchvision import transforms\n",
    "\n",
    "# Define a transform to pre-process the training images.\n",
    "transform_train = transforms.Compose([ \n",
    "    transforms.Resize(256),                          # smaller edge of image resized to 256\n",
    "    transforms.RandomCrop(224),                      # get 224x224 crop from random location\n",
    "    transforms.RandomHorizontalFlip(),               # horizontally flip image with probability=0.5\n",
    "    transforms.ToTensor(),                           # convert the PIL Image to a tensor\n",
    "    transforms.Normalize((0.485, 0.456, 0.406),      # normalize image for pre-trained model\n",
    "                         (0.229, 0.224, 0.225))])\n",
    "\n",
    "# Set the minimum word count threshold.\n",
    "vocab_threshold = 5\n",
    "\n",
    "# Specify the batch size.\n",
    "batch_size = 10\n",
    "\n",
    "# Obtain the data loader.\n",
    "data_loader = get_loader(transform=transform_train,\n",
    "                         mode='train',\n",
    "                         batch_size=batch_size,\n",
    "                         vocab_threshold=vocab_threshold,\n",
    "                         vocab_from_file=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "When you ran the code cell above, the data loader was stored in the variable `data_loader`.  \n",
    "\n",
    "You can access the corresponding dataset as `data_loader.dataset`.  This dataset is an instance of the `CoCoDataset` class in **data_loader.py**.  If you are unfamiliar with data loaders and datasets, you are encouraged to review [this PyTorch tutorial](http://pytorch.org/tutorials/beginner/data_loading_tutorial.html).\n",
    "\n",
    "### Exploring the `__getitem__` Method\n",
    "\n",
    "The `__getitem__` method in the `CoCoDataset` class determines how an image-caption pair is pre-processed before being incorporated into a batch.  This is true for all `Dataset` classes in PyTorch; if this is unfamiliar to you, please review [the tutorial linked above](http://pytorch.org/tutorials/beginner/data_loading_tutorial.html). \n",
    "\n",
    "When the data loader is in training mode, this method begins by first obtaining the filename (`path`) of a training image and its corresponding caption (`caption`).\n",
    "\n",
    "#### Image Pre-Processing \n",
    "\n",
    "Image pre-processing is relatively straightforward (from the `__getitem__` method in the `CoCoDataset` class):\n",
    "```python\n",
    "# Convert image to tensor and pre-process using transform\n",
    "image = Image.open(os.path.join(self.img_folder, path)).convert('RGB')\n",
    "image = self.transform(image)\n",
    "```\n",
    "After loading the image in the training folder with name `path`, the image is pre-processed using the same transform (`transform_train`) that was supplied when instantiating the data loader.  \n",
    "\n",
    "#### Caption Pre-Processing \n",
    "\n",
    "The captions also need to be pre-processed and prepped for training. In this example, for generating captions, we are aiming to create a model that predicts the next token of a sentence from previous tokens, so we turn the caption associated with any image into a list of tokenized words, before casting it to a PyTorch tensor that we can use to train the network.\n",
    "\n",
    "To understand in more detail how COCO captions are pre-processed, we'll first need to take a look at the `vocab` instance variable of the `CoCoDataset` class.  The code snippet below is pulled from the `__init__` method of the `CoCoDataset` class:\n",
    "```python\n",
    "def __init__(self, transform, mode, batch_size, vocab_threshold, vocab_file, start_word, \n",
    "        end_word, unk_word, annotations_file, vocab_from_file, img_folder):\n",
    "        ...\n",
    "        self.vocab = Vocabulary(vocab_threshold, vocab_file, start_word,\n",
    "            end_word, unk_word, annotations_file, vocab_from_file)\n",
    "        ...\n",
    "```\n",
    "From the code snippet above, you can see that `data_loader.dataset.vocab` is an instance of the `Vocabulary` class from **vocabulary.py**.  Take the time now to verify this for yourself by looking at the full code in **data_loader.py**.  \n",
    "\n",
    "We use this instance to pre-process the COCO captions (from the `__getitem__` method in the `CoCoDataset` class):\n",
    "\n",
    "```python\n",
    "# Convert caption to tensor of word ids.\n",
    "tokens = nltk.tokenize.word_tokenize(str(caption).lower())   # line 1\n",
    "caption = []                                                 # line 2\n",
    "caption.append(self.vocab(self.vocab.start_word))            # line 3\n",
    "caption.extend([self.vocab(token) for token in tokens])      # line 4\n",
    "caption.append(self.vocab(self.vocab.end_word))              # line 5\n",
    "caption = torch.Tensor(caption).long()                       # line 6\n",
    "```\n",
    "\n",
    "As you will see soon, this code converts any string-valued caption to a list of integers, before casting it to a PyTorch tensor.  To see how this code works, we'll apply it to the sample caption in the next code cell."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "sample_caption = 'A person doing a trick on a rail while riding a skateboard.'"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In **`line 1`** of the code snippet, every letter in the caption is converted to lowercase, and the [`nltk.tokenize.word_tokenize`](http://www.nltk.org/) function is used to obtain a list of string-valued tokens.  Run the next code cell to visualize the effect on `sample_caption`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "['a', 'person', 'doing', 'a', 'trick', 'on', 'a', 'rail', 'while', 'riding', 'a', 'skateboard', '.']\n"
     ]
    }
   ],
   "source": [
    "import nltk\n",
    "\n",
    "sample_tokens = nltk.tokenize.word_tokenize(str(sample_caption).lower())\n",
    "print(sample_tokens)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In **`line 2`** and **`line 3`** we initialize an empty list and append an integer to mark the start of a caption.  The [paper](https://arxiv.org/pdf/1411.4555.pdf) that you are encouraged to implement uses a special start word (and a special end word, which we'll examine below) to mark the beginning (and end) of a caption.\n",
    "\n",
    "This special start word (`\"<start>\"`) is decided when instantiating the data loader and is passed as a parameter (`start_word`).  You are **required** to keep this parameter at its default value (`start_word=\"<start>\"`).\n",
    "\n",
    "As you will see below, the integer `0` is always used to mark the start of a caption."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Special start word: <start>\n",
      "sample_caption [0]\n"
     ]
    }
   ],
   "source": [
    "sample_caption = []\n",
    "\n",
    "start_word = data_loader.dataset.vocab.start_word\n",
    "print('Special start word:', start_word)\n",
    "sample_caption.append(data_loader.dataset.vocab(start_word))\n",
    "print('sample_caption',sample_caption)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In **`line 4`**, we continue the list by adding integers that correspond to each of the tokens in the caption."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "sample_caption [0, 3, 98, 754, 3, 396, 39, 3, 1009, 207, 139, 3, 753, 18]\n"
     ]
    }
   ],
   "source": [
    "sample_caption.extend([data_loader.dataset.vocab(token) for token in sample_tokens])\n",
    "print('sample_caption',sample_caption)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In **`line 5`**, we append a final integer to mark the end of the caption.  \n",
    "\n",
    "Identical to the case of the special start word (above), the special end word (`\"<end>\"`) is decided when instantiating the data loader and is passed as a parameter (`end_word`).  You are **required** to keep this parameter at its default value (`end_word=\"<end>\"`).\n",
    "\n",
    "As you will see below, the integer `1` is always used to  mark the end of a caption."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Special end word: <end>\n",
      "[0, 3, 98, 754, 3, 396, 39, 3, 1009, 207, 139, 3, 753, 18, 1]\n"
     ]
    }
   ],
   "source": [
    "end_word = data_loader.dataset.vocab.end_word\n",
    "print('Special end word:', end_word)\n",
    "\n",
    "sample_caption.append(data_loader.dataset.vocab(end_word))\n",
    "print(sample_caption)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Finally, in **`line 6`**, we convert the list of integers to a PyTorch tensor and cast it to [long type](http://pytorch.org/docs/master/tensors.html#torch.Tensor.long).  You can read more about the different types of PyTorch tensors on the [website](http://pytorch.org/docs/master/tensors.html)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "tensor([    0,     3,    98,   754,     3,   396,    39,     3,  1009,\n",
      "          207,   139,     3,   753,    18,     1])\n"
     ]
    }
   ],
   "source": [
    "import torch\n",
    "\n",
    "sample_caption = torch.Tensor(sample_caption).long()\n",
    "print(sample_caption)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And that's it!  In summary, any caption is converted to a list of tokens, with _special_ start and end tokens marking the beginning and end of the sentence:\n",
    "```\n",
    "[<start>, 'a', 'person', 'doing', 'a', 'trick', 'while', 'riding', 'a', 'skateboard', '.', <end>]\n",
    "```\n",
    "This list of tokens is then turned into a list of integers, where every distinct word in the vocabulary has an associated integer value:\n",
    "```\n",
    "[0, 3, 98, 754, 3, 396, 207, 139, 3, 753, 18, 1]\n",
    "```\n",
    "Finally, this list is converted to a PyTorch tensor.  All of the captions in the COCO dataset are pre-processed using this same procedure from **`lines 1-6`** described above.  \n",
    "\n",
    "As you saw, in order to convert a token to its corresponding integer, we call `data_loader.dataset.vocab` as a function.  The details of how this call works can be explored in the `__call__` method in the `Vocabulary` class in **vocabulary.py**.  \n",
    "\n",
    "```python\n",
    "def __call__(self, word):\n",
    "    if not word in self.word2idx:\n",
    "        return self.word2idx[self.unk_word]\n",
    "    return self.word2idx[word]\n",
    "```\n",
    "\n",
    "The `word2idx` instance variable is a Python [dictionary](https://docs.python.org/3/tutorial/datastructures.html#dictionaries) that is indexed by string-valued keys (mostly tokens obtained from training captions).  For each key, the corresponding value is the integer that the token is mapped to in the pre-processing step.\n",
    "\n",
    "Use the code cell below to view a subset of this dictionary."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "dict_items([('<start>', 0), ('<end>', 1), ('<unk>', 2), ('a', 3), ('very', 4), ('clean', 5), ('and', 6), ('well', 7), ('decorated', 8), ('empty', 9), ('bathroom', 10), ('panoramic', 11), ('view', 12), ('of', 13), ('kitchen', 14), ('all', 15), ('its', 16), ('appliances', 17), ('.', 18), ('blue', 19), ('white', 20), ('with', 21), ('butterfly', 22), ('themed', 23), ('wall', 24), ('tiles', 25), ('photo', 26), ('dining', 27), ('room', 28), ('stop', 29), ('sign', 30), ('across', 31), ('the', 32), ('street', 33), ('from', 34), ('red', 35), ('car', 36), ('vandalized', 37), ('beetle', 38), ('on', 39), ('road', 40), ('border', 41), ('butterflies', 42), ('paint', 43), ('walls', 44), ('above', 45), ('it', 46), ('an', 47), ('angled', 48), ('beautifully', 49), ('two', 50), ('people', 51), ('are', 52), ('walking', 53), ('down', 54), ('beach', 55), ('sink', 56), ('toilet', 57), ('inside', 58), ('small', 59), ('black', 60), ('square', 61), ('tile', 62), ('floor', 63), ('that', 64), ('needs', 65), ('repairs', 66), ('vanity', 67), ('contains', 68), ('sinks', 69), ('towel', 70), ('for', 71), ('each', 72), ('several', 73), ('metal', 74), ('balls', 75), ('sit', 76), ('in', 77), ('sand', 78), ('near', 79), ('group', 80), ('carrying', 81), ('surf', 82), ('boards', 83), ('brown', 84), ('cabinets', 85), (',', 86), ('backsplash', 87), ('grey', 88), ('counters', 89), ('surfer', 90), ('woman', 91), ('child', 92), ('walk', 93), ('few', 94), ('dim', 95), ('transportation', 96), ('system', 97), ('person', 98), ('protected', 99), ('rain', 100), ('by', 101), ('their', 102), ('umbrella', 103), ('walks', 104), ('has', 105), ('interesting', 106), ('women', 107), ('preparing', 108), ('food', 109), ('one', 110), ('at', 111), ('table', 112), ('home', 113), ('light', 114), ('cat', 115), ('stuck', 116), ('slightly', 117), ('opened', 118), ('window', 119), ('bicycles', 120), ('front', 121), ('shop', 122), ('green', 123), ('tiled', 124), ('highlighted', 125), ('low', 126), ('overhead', 127), ('lighting', 128), ('bicycle', 129), ('is', 130), ('parked', 131), ('bench', 132), ('night', 133), ('horse', 134), ('grazing', 135), ('grass', 136), ('house', 137), ('someone', 138), ('riding', 139), ('bike', 140), ('pedestal', 141), ('located', 142), ('poorly', 143), ('lit', 144), ('this', 145), ('pick-up', 146), ('game', 147), ('shirts', 148), ('basketball', 149), ('bathtub', 150), ('shower', 151), ('mirror', 152), ('cabinet', 153), ('countertop', 154), ('includes', 155), ('apple', 156), ('phone', 157), ('teenagers', 158), ('surfboards', 159), ('his', 160), ('to', 161), ('indoor', 162), ('good', 163), ('closeup', 164), ('fire', 165), ('hydrant', 166), ('including', 167), ('chains', 168), ('man', 169), ('standing', 170), ('arms', 171), ('crossed', 172), ('purple', 173), ('bus', 174), ('dressed', 175), ('as', 176), ('nun', 177), ('tall', 178), ('herb', 179), ('toaster', 180), ('oven', 181), ('lady', 182), ('purse', 183), ('along', 184), ('side', 185), ('brightly', 186), ('colored', 187), ('wide', 188), ('angle', 189), ('work', 190), ('area', 191), ('around', 192), ('many', 193), ('silver', 194), ('round', 195), ('ground', 196), ('working', 197), ('counter', 198), ('illuminated', 199), ('sunlight', 200), ('granite', 201), ('countertops', 202), ('skinny', 203), ('field', 204), ('seagulls', 205), ('flying', 206), ('while', 207), ('trucks', 208), ('parking', 209), ('lot', 210), ('no', 211), ('doors', 212), ('dishwasher', 213), ('refrigerator', 214), ('modern', 215), ('glass', 216), ('pieces', 217), ('demonstration', 218), ('maintained', 219), ('hotel', 220), ('making', 221), ('angry', 222), ('face', 223), ('sitting', 224), ('motel', 225), ('nice', 226), ('hood', 227), ('city', 228), ('sidewalk', 229), ('lined', 230), ('lamp', 231), ('posts', 232), ('tv', 233), ('public', 234), ('restroom', 235), ('been', 236), ('photographed', 237), ('sepia', 238), ('old', 239), ('styled', 240), ('what', 241), ('appears', 242), ('be', 243), ('golden', 244), ('gate', 245), ('bridge', 246), ('peeking', 247), ('out', 248), ('rolled', 249), ('there', 250), ('some', 251), ('pet', 252), ('young', 253), ('boy', 254), ('surfing', 255), ('waves', 256), ('top', 257), ('covered', 258), ('brass', 259), ('pots', 260), ('pans', 261), ('shaving', 262), ('her', 263), ('wooden', 264), ('sky', 265), ('full', 266), ('colorful', 267), ('kites', 268), ('mountain', 269), ('rides', 270), ('river', 271), ('stand', 272), ('lights', 273), ('cupboard', 274), ('raft', 275), ('atop', 276), ('boat', 277), ('water', 278), ('cars', 279), ('trash', 280), ('can', 281), ('garage', 282), ('shorts', 283), ('seat', 284), ('looking', 285), ('jumping', 286), ('onto', 287), ('folded', 288), ('balancing', 289), ('image', 290), ('children', 291), ('paying', 292), ('attention', 293), ('up', 294), ('mill', 295), ('about', 296), ('background', 297), ('compact', 298), ('mounted', 299), ('roof', 300), ('crisp', 301), ('neutral', 302), ('embellished', 303), ('scene', 304), ('stainless', 305), ('steel', 306), ('appliance', 307), ('checkered', 308), ('pattern', 309), ('talking', 310), ('self', 311), ('portrait', 312), ('fancy', 313), ('cell', 314), ('accessories', 315), ('set', 316), ('without', 317), ('snowy', 318), ('skis', 319), ('towels', 320), ('laid', 321), ('stuffed', 322), ('animal', 323), ('laying', 324), ('bed', 325), ('sits', 326), ('open', 327), ('plates', 328), ('vegetables', 329), ('couple', 330), ('toilette', 331), ('computer', 332), ('taking', 333), ('picture', 334), ('large', 335), ('hours', 336), ('eating', 337), ('blurry', 338), ('rider', 339), ('zooms', 340), ('past', 341), ('new', 342), ('mercedes', 343), ('skiers', 344), ('peak', 345), ('thee', 346), ('cats', 347), ('sleeping', 348), ('featuring', 349), ('everything', 350), ('lies', 351), ('smaller', 352), ('ball', 353), ('board', 354), ('playing', 355), ('frisbee', 356), ('washing', 357), ('dishes', 358), ('backpack', 359), ('holding', 360), ('arm', 361), ('shoulders', 362), ('girl', 363), ('next', 364), ('him', 365), ('three', 366), ('owners', 367), ('using', 368), ('go', 369), ('baby', 370), ('dog', 371), ('clock', 372), ('hangs', 373), ('multiple', 374), ('photos', 375), ('extends', 376), ('hand', 377), ('catch', 378), ('silverware', 379), ('glasses', 380), ('bottle', 381), ('wine', 382), ('vegetable', 383), ('age', 384), ('equipment', 385), ('kite', 386), ('shape', 387), ('bottom', 388), ('half', 389), ('fashioned', 390), ('ware', 391), ('middle', 392), ('croquet', 393), ('painted', 394), ('does', 395), ('trick', 396), ('surfboard', 397), ('under', 398), ('bunch', 399), ('strapped', 400), ('six', 401), ('time', 402), ('riders', 403), ('goes', 404), ('shot', 405), ('laundry', 406), ('bear', 407), (\"'s\", 408), ('other', 409), ('places', 410), ('friend', 411), ('seagull', 412), ('perches', 413), ('van', 414), ('parachutes', 415), ('fly', 416), ('through', 417), ('girls', 418), ('lunch', 419), ('stocked', 420), ('supplies', 421), ('dish', 422), ('chef', 423), ('opens', 424), ('beside', 425), ('island', 426), ('random', 427), ('being', 428), ('prepared', 429), ('get', 430), ('newly', 431), ('family', 432), ('dirty', 433), ('clothes', 434), ('over', 435), ('edge', 436), ('body', 437), ('sun', 438), ('sets', 439), ('windows', 440), ('poses', 441), ('hill', 442), ('demonstrating', 443), ('act', 444), ('shelves', 445), ('wood', 446), ('assorted', 447), ('decorations', 448), ('plastic', 449), ('tarp', 450), ('courtyard', 451), ('reaches', 452), ('wave', 453), ('men', 454), ('seems', 455), ('others', 456), ('stairs', 457), ('lead', 458), ('double', 459), ('into', 460), ('footed', 461), ('tub', 462), ('bush', 463), ('bumper', 464), ('sticker', 465), ('word', 466), ('buffet', 467), ('different', 468), ('types', 469), ('organized', 470), ('closet', 471), ('female', 472), ('student', 473), ('bowls', 474), ('microwave', 475), ('storefronts', 476), ('right', 477), ('platform', 478), ('silhouette', 479), ('sunset', 480), ('tent', 481), ('stationed', 482), ('lane', 483), ('bath', 484), ('rug', 485), ('pile', 486), ('bikes', 487), ('rack', 488), ('outside', 489), ('stools', 490), ('takes', 491), ('selfie', 492), ('wrapped', 493), ('chain', 494), ('evergreen', 495), ('sprig', 496), ('grazes', 497), ('trees', 498), ('dogs', 499), ('beneath', 500), ('owner', 501), ('pristine', 502), ('waiting', 503), ('used', 504), ('smiles', 505), ('who', 506), ('wearing', 507), ('together', 508), ('enjoying', 509), ('company', 510), ('crowd', 511), ('prepare', 512), ('ski', 513), ('snow', 514), ('slopes', 515), ('video', 516), ('skiiers', 517), ('gathered', 518), ('base', 519), ('travel', 520), ('guy', 521), ('building', 522), ('another', 523), ('shave', 524), ('back', 525), ('neatly', 526), ('stacked', 527), ('shelf', 528), ('played', 529), ('yard', 530), ('copper', 531), ('pot', 532), ('racks', 533), ('stove', 534), ('restaurant', 535), ('filled', 536), ('watches', 537), ('boys', 538), ('play', 539), ('singing', 540), ('hikers', 541), ('climb', 542), ('snow-covered', 543), ('winter', 544), ('clutter', 545), ('blocks', 546), ('antique', 547), ('leaving', 548), ('reflection', 549), ('guys', 550), ('kid', 551), ('spa', 552), ('like', 553), ('shown', 554), ('only', 555), ('scissors', 556), ('loaded', 557), ('end', 558), ('orange', 559), ('gray', 560), ('accents', 561), ('door', 562), ('behind', 563), ('corner', 564), ('bricks', 565), ('lining', 566), ('teddy', 567), ('dimly', 568), ('lying', 569), ('bedspread', 570), ('mattress', 571), ('ocean', 572), ('loving', 573), ('pose', 574), ('cake', 575), ('biker', 576), ('stands', 577), ('legs', 578), ('stone', 579), ('focus', 580), ('shirtless', 581), ('pink', 582), ('drinking', 583), ('dark', 584), ('profile', 585), ('before', 586), ('tops', 587), ('individual', 588), ('covers', 589), ('himself', 590), ('rainy', 591), ('day', 592), ('cleaning', 593), ('products', 594), ('four', 595), ('lawn', 596), ('females', 597), ('ready', 598), ('skate', 599), ('cement', 600), ('seating', 601), ('basket', 602), ('yellow', 603), ('keyboard', 604), ('having', 605), ('slice', 606), ('bread', 607), ('jelly', 608), ('crossing', 609), ('placed', 610), ('passenger', 611), ('same', 612), ('chairs', 613), ('cupboards', 614), ('sandy', 615), ('mid', 616), ('sized', 617), ('leaning', 618), ('forward', 619), ('equipped', 620), ('support', 621), ('bars', 622), ('disabled', 623), ('television', 624), ('reflected', 625), ('off', 626), ('nap', 627), ('lays', 628), ('chest', 629), ('attached', 630), ('version', 631), ('personal', 632), ('dual', 633), ('wrap', 634), ('shadow', 635), ('un', 636), ('occupied', 637), ('allover', 638), ('tiling', 639), ('wig', 640), ('shopping', 641), ('center', 642), ('containing', 643), ('step', 644), ('close', 645), ('curtain', 646), ('he', 647), ('falls', 648), ('asleep', 649), ('flat', 650), ('screen', 651), ('box', 652), ('tissues', 653), ('remote', 654), ('control', 655), ('nearly', 656), ('pets', 657), ('college', 658), ('campus', 659), ('splash', 660), ('added', 661), ('cleaned', 662), ('air', 663), ('just', 664), ('construction', 665), ('strip', 666), ('single', 667), ('teenage', 668), ('wire', 669), ('against', 670), ('surrounded', 671), ('handrails', 672), ('cards', 673), ('parade', 674), ('win', 675), ('industrial', 676), ('ovens', 677), ('pictured', 678), ('bowl', 679), ('separate', 680), ('showing', 681), ('inspecting', 682), ('project', 683), ('banquet', 684), ('tables', 685), ('held', 686), ('variety', 687), ('meats', 688), ('dips', 689), ('pastries', 690), ('plaza', 691), ('stores', 692), ('sedan', 693), ('cloudy', 694), ('microphones', 695), ('ages', 696), ('skiing', 697), ('slope', 698), ('gathering', 699), ('lighted', 700), ('something', 701), ('groceries', 702), ('race', 703), ('busy', 704), ('athletes', 705), ('appear', 706), ('lots', 707), ('space', 708), ('spiral', 709), ('hanging', 710), ('chihuahua', 711), ('attractive', 712), ('couch', 713), ('looks', 714), ('them', 715), ('older', 716), ('getting', 717), ('lookers', 718), ('refridgerator', 719), ('friends', 720), ('enjoy', 721), ('grassy', 722), ('fenced', 723), ('hooked', 724), ('checking', 725), ('holds', 726), ('leash', 727), ('fridge', 728), ('halfway', 729), ('during', 730), ('old-fashioned', 731), ('biking', 732), ('storefront', 733), ('sister', 734), ('trying', 735), ('high', 736), ('items', 737), ('shopper', 738), ('downtown', 739), ('mall', 740), ('kids', 741), ('master', 742), ('bedroom', 743), ('oddly', 744), ('shaped', 745), ('wires', 746), ('poles', 747), ('hall', 748), ('opening', 749), ('rooms', 750), ('nicely', 751), ('metallic', 752), ('skateboard', 753), ('doing', 754), ('technology', 755), ('spread', 756), ('spaniel', 757), ('leans', 758), ('subway', 759), ('court', 760), ('below', 761), ('flowers', 762), ('hits', 763), ('big', 764), ('spending', 765), ('watching', 766), ('park', 767), ('flowering', 768), ('tree', 769), ('nearby', 770), ('were', 771), ('captured', 772), ('altered', 773), ('serving', 774), ('quiet', 775), ('adults', 776), ('meal', 777), ('hallway', 778), ('shirt', 779), ('jeans', 780), ('use', 781), ('professional', 782), ('laptop', 783), ('or', 784), ('kind', 785), ('spice', 786), ('crosswalk', 787), ('bags', 788), ('hands', 789), ('spacious', 790), ('cross', 791), ('intersection', 792), ('skateboarding', 793), ('cooking', 794), ('paneled', 795), ('reflecting', 796), ('opposite', 797), ('lcd', 798), ('panel', 799), ('pad', 800), ('pretty', 801), ('spotless', 802), ('bidet', 803), ('beautiful', 804), ('blonde', 805), ('multicolored', 806), ('kiosk', 807), ('cyclists', 808), ('asphalt', 809), ('porcelain', 810), ('waking', 811), ('coat', 812), ('wireless', 813), ('role', 814), ('games', 815), ('hat', 816), ('traveling', 817), ('plate', 818), ('armor', 819), ('helmet', 820), ('reflective', 821), ('marble', 822), ('rust', 823), ('filthy', 824), ('alley', 825), ('hard', 826), ('waits', 827), ('frilly', 828), ('ramp', 829), ('asian', 830), ('lounge', 831), ('baskets', 832), ('goods', 833), ('floors', 834), ('gentleman', 835), ('alongside', 836), ('storage', 837), ('skateboarder', 838), ('airborne', 839), ('banana', 840), ('if', 841), ('telephone', 842), ('receiver', 843), ('bicyclists', 844), ('underneath', 845), ('drying', 846), ('modified', 847), ('read', 848), ('dress', 849), ('brushing', 850), ('teeth', 851), ('highly', 852), ('displaying', 853), ('train', 854), ('station', 855), ('made', 856), ('living', 857), ('toothbrush', 858), ('leading', 859), ('where', 860), ('tires', 861), ('examines', 862), ('surfers', 863), ('ride', 864), ('ferry', 865), ('vespas', 866), ('books', 867), ('chair', 868), ('store', 869), ('doll', 870), ('cup', 871), ('coffee', 872), ('brushes', 873), ('bikers', 874), ('turn', 875), ('fountain', 876), ('town', 877), ('bicyclist', 878), ('wait', 879), ('shines', 880), ('keys', 881), ('lettering', 882), ('competing', 883), ('handicap', 884), ('bar', 885), ('natural', 886), ('fronted', 887), ('combo', 888), ('passing', 889), ('long', 890), ('staring', 891), ('facing', 892), ('knight', 893), ('costume', 894), ('motorcycle', 895), ('driving', 896), ('stack', 897), ('beverages', 898), ('standup', 899), ('male', 900), ('dump', 901), ('truck', 902), ('commercial', 903), ('mirrors', 904), ('toothbrushes', 905), ('pole', 906), ('power', 907), ('lines', 908), ('seats', 909), ('blow', 910), ('candle', 911), ('birthday', 912), ('besides', 913), ('soccer', 914), ('fan', 915), ('dressing', 916), ('japanese', 917), ('displayed', 918), ('married', 919), ('posing', 920), ('piece', 921), ('performing', 922), ('passes', 923), ('shinning', 924), ('bright', 925), ('entryway', 926), ('tricks', 927), ('tan', 928), ('jacuzzi', 929), ('sweater', 930), ('inspired', 931), ('alone', 932), ('locked', 933), ('meter', 934), ('catches', 935), ('but', 936), ('fall', 937), ('stopped', 938), ('downed', 939), ('drink', 940), ('outfit', 941), ('cutout', 942), ('sheer', 943), ('curtains', 944), ('skiis', 945), ('tissue', 946), ('dispenser', 947), ('unused', 948), ('2', 949), ('ceramic', 950), ('dinner', 951), ('tiny', 952), ('little', 953), ('reaching', 954), ('drawer', 955), ('arranged', 956), ('display', 957), ('decoratively', 958), ('resting', 959), ('matching', 960), ('bathing', 961), ('hot', 962), ('touches', 963), ('royal', 964), ('refrigerators', 965), ('workstation', 966), ('indicate', 967), ('have', 968), ('gold', 969), ('rectangular', 970), ('putting', 971), ('away', 972), ('after', 973), ('curtained', 974), ('writing', 975), ('pretending', 976), ('talk', 977), ('though', 978), ('sports', 979), ('going', 980), ('smiling', 981), ('stucco', 982), ('planks', 983), ('celebrating', 984), ('special', 985), ('occasion', 986), ('pressed', 987), ('lips', 988), ('container', 989), ('color', 990), ('fresh', 991), ('airy', 992), ('paws', 993), ('overexposed', 994), ('apartment', 995), ('sparse', 996), ('furniture', 997), ('moving', 998), ('boxes', 999), ('orchids', 1000), ('way', 1001), ('consisting', 1002), ('striped', 1003), ('utensils', 1004), ('shiny', 1005), ('stall', 1006), ('carton', 1007), ('lift', 1008), ('rail', 1009), ('blurred', 1010), ('lone', 1011), ('skier', 1012), ('bundled', 1013), ('cow', 1014), ('suit', 1015), ('towards', 1016), ('sculpture', 1017), ('herself', 1018), ('coffeemaker', 1019), ('pictures', 1020), ('seen', 1021), ('elegant', 1022), ('approach', 1023), ('cone', 1024), ('barrier', 1025), ('suburban', 1026), ('pantry', 1027), ('visible', 1028), ('formal', 1029), ('locking', 1030), ('hut', 1031), ('glides', 1032), ('urban', 1033), ('following', 1034), ('cyclist', 1035), ('which', 1036), ('identical', 1037), ('mat', 1038), ('tucked', 1039), ('signs', 1040), ('narrow', 1041), ('five', 1042), ('costumes', 1043), ('fitted', 1044), ('motif', 1045), ('foreign', 1046), ('numerous', 1047), ('level', 1048), ('various', 1049), ('kisses', 1050), ('hugs', 1051), ('siamese', 1052), ('swings', 1053), ('hula', 1054), ('hoop', 1055), ('reading', 1056), ('lap', 1057), ('dairy', 1058), ('queen', 1059), ('cooks', 1060), ('chatting', 1061), ('scooters', 1062), ('viewing', 1063), ('gather', 1064), ('giving', 1065), ('``', 1066), ('thumbs', 1067), (\"''\", 1068), ('unfurnished', 1069), ('tropical', 1070), ('hold', 1071), ('renovation', 1072), ('exposed', 1073), ('fence', 1074), ('makeup', 1075), ('objects', 1076), ('blender', 1077), ('blocked', 1078), ('tape', 1079), ('cold', 1080), ('pay', 1081), ('assortment', 1082), ('daytime', 1083), ('reveals', 1084), ('stares', 1085), ('design', 1086), ('booth', 1087), ('path', 1088), ('lower', 1089), ('reads', 1090), ('turning', 1091), ('carting', 1092), ('ear', 1093), ('handsome', 1094), ('girlfriend', 1095), ('ledge', 1096), ('closed', 1097), ('toddler', 1098), ('reach', 1099), ('utensil', 1100), ('decker', 1101), ('ben', 1102), ('shining', 1103), ('cut', 1104), ('lime', 1105), ('lotion', 1106), ('adorable', 1107), ('5', 1108), ('holder', 1109), ('rim', 1110), ('tooth', 1111), ('household', 1112), ('newspaper', 1113), ('falling', 1114), ('serve', 1115), ('maker', 1116), ('wade', 1117), ('sea', 1118), ('chefs', 1119), ('umbrellas', 1120), ('country', 1121), ('pushes', 1122), ('damaged', 1123), ('areas', 1124), ('bad', 1125), ('earth', 1126), ('toned', 1127), ('hang', 1128), ('rod', 1129), ('stark', 1130), ('testing', 1131), ('pic', 1132), ('wagon', 1133), ('propped', 1134), ('hers', 1135), ('accent', 1136), ('ample', 1137), ('pool', 1138), ('flower', 1139), ('ornament', 1140), ('built', 1141), ('haired', 1142), ('sleeps', 1143), ('fixtures', 1144), ('cutting', 1145), ('fourth', 1146), ('july', 1147), ('recently', 1148), ('renovated', 1149), ('done', 1150), ('tones', 1151), ('ladle', 1152), ('soup', 1153), ('skylight', 1154), ('labels', 1155), ('outdoor', 1156), ('cafe', 1157), ('urinals', 1158), ('minimalist', 1159), ('paper', 1160), ('strangely', 1161), ('pair', 1162), ('remodeled', 1163), ('demolished', 1164), ('major', 1165), ('advertising', 1166), ('faucet', 1167), ('topped', 1168), ('residential', 1169), ('head', 1170), ('t.v', 1171), ('cardboard', 1172), ('sanding', 1173), ('conversation', 1174), ('things', 1175), ('rusty', 1176), ('pausing', 1177), ('cook', 1178), ('camera', 1179), ('run', 1180), ('dingy', 1181), ('flooring', 1182), ('drawers', 1183), ('flash', 1184), ('setup', 1185), ('take', 1186), ('basin', 1187), ('sing', 1188), ('features', 1189), ('covering', 1190), ('heavily', 1191), ('lacy', 1192), ('cloths', 1193), ('overlooking', 1194), ('darkened', 1195), ('pier', 1196), ('wheeled', 1197), ('smoothie', 1198), ('coming', 1199), ('makes', 1200), ('whole', 1201), ('dinosaur', 1202), ('pockets', 1203), ('cluttered', 1204), ('cracked', 1205), ('separated', 1206), ('vespa', 1207), ('fake', 1208), ('style', 1209), ('sides', 1210), ('not', 1211), ('attended', 1212), ('london', 1213), ('patterned', 1214), ('cushions', 1215), ('adorn', 1216), ('gas', 1217), ('stations', 1218), ('employees', 1219), ('diner', 1220), ('tasks', 1221), ('mass', 1222), ('transit', 1223), ('vehicle', 1224), ('urinal', 1225), ('fluffy', 1226), ('comfortably', 1227), ('ingredients', 1228), ('buckets', 1229), ('sliding', 1230), ('drive', 1231), ('thru', 1232), ('pulling', 1233), ('trailer', 1234), ('brick', 1235), ('strange', 1236), ('ladies', 1237), ('containers', 1238), ('collection', 1239), ('remodel', 1240), ('entrance', 1241), ('set-up', 1242), ('stew', 1243), ('pan', 1244), ('robes', 1245), ('piles', 1246), ('shoes', 1247), ('d', 1248), ('claw', 1249), ('foot', 1250), ('toiletries', 1251), ('state', 1252), ('pointed', 1253), ('traffic', 1254), ('focused', 1255), ('united', 1256), ('states', 1257), ('postal', 1258), ('service', 1259), ('delivers', 1260), ('mail', 1261), ('weather', 1262), ('case', 1263), ('deep', 1264), ('commode', 1265), ('broken', 1266), ('wth', 1267), ('kissing', 1268), ('hipster', 1269), ('fine', 1270), ('clothing', 1271), ('bold', 1272), ('fabric', 1273), ('boots', 1274), ('automatic', 1275), ('chained', 1276), ('disorganized', 1277), ('missing', 1278), ('huge', 1279), ('double-decker', 1280), ('picnic', 1281), ('rustic', 1282), ('condiments', 1283), ('cookware', 1284), ('washroom', 1285), ('motor', 1286), ('sticking', 1287), ('hunched', 1288), ('balloons', 1289), ('floating', 1290), ('buildings', 1291), ('look', 1292), ('blvd', 1293), ('st', 1294), ('toy', 1295), ('feet', 1296), ('spooning', 1297), ('terrier', 1298), ('motorbike', 1299), ('monster', 1300), ('mask', 1301), ('horses', 1302), ('mopeds', 1303), ('distance', 1304), ('watch', 1305), ('setting', 1306), ('limes', 1307), ('slowly', 1308), ('pics', 1309), ('washer', 1310), ('cart', 1311), ('jump', 1312), ('fairly', 1313), ('typical', 1314), ('toliet', 1315), ('resort', 1316), ('message', 1317), ('tie', 1318), ('smoking', 1319), ('cigarette', 1320), ('rolls', 1321), ('coverings', 1322), ('tank', 1323), ('lid', 1324), ('tp', 1325), ('workers', 1326), ('toothpaste', 1327), ('mouthwash', 1328), ('cups', 1329), ('upside', 1330), ('fast', 1331), ('lush', 1332), ('drives', 1333), ('roads', 1334), ('palm', 1335), ('photograph', 1336), ('boarders', 1337), ('backwards', 1338), ('land', 1339), ('curly', 1340), ('grown', 1341), ('swinging', 1342), ('cabin', 1343), ('ornately', 1344), ('carpet', 1345), ('dresses', 1346), ('scenic', 1347), ('windmills', 1348), ('horizon', 1349), ('pedestrians', 1350), ('hardwood', 1351), ('prepares', 1352), ('names', 1353), ('micro', 1354), ('mini', 1355), ('interior', 1356), ('desk', 1357), ('bank', 1358), ('kneeling', 1359), ('scooping', 1360), ('forehead', 1361), ('bunches', 1362), ('bananas', 1363), ('market', 1364), ('sparsely', 1365), ('furnished', 1366), ('skater', 1367), ('skaters', 1368), ('clear', 1369), ('boardwalk', 1370), ('overlook', 1371), ('vent', 1372), ('plowing', 1373), ('pavement', 1374), ('breakfast', 1375), ('farm', 1376), ('wok', 1377), ('racers', 1378), ('sunny', 1379), ('european', 1380), ('vehicles', 1381), ('pause', 1382), ('hitting', 1383), ('bareback', 1384), ('wallpaper', 1385), ('snuggled', 1386), ('ripe', 1387), ('injured', 1388), ('displays', 1389), ('powered', 1390), ('fruit', 1391), ('beige', 1392), ('forest', 1393), ('parents', 1394), ('accessible', 1395), ('crack', 1396), ('combination', 1397), ('extension', 1398), ('plug', 1399), ('surface', 1400), ('since', 1401), ('ornate', 1402), ('brush', 1403), ('homemade', 1404), ('doughnuts', 1405), ('neat', 1406), ('adjusting', 1407), ('moped', 1408), ('running', 1409), ('was', 1410), ('removed', 1411), ('sizes', 1412), ('featured', 1413), ('soap', 1414), ('shoot', 1415), ('capture', 1416), ('stationary', 1417), ('celebration', 1418), ('plain', 1419), ('posted', 1420), ('4-way', 1421), ('cradle', 1422), ('scooter', 1423), ('crowded', 1424), ('driver', 1425), ('item', 1426), ('scattered', 1427), ('cast', 1428), ('iron', 1429), ('airplane', 1430), ('pumps', 1431), ('they', 1432), ('provided', 1433), ('amenities', 1434), ('heels', 1435), ('enclosed', 1436), ('strainer', 1437), ('knife', 1438), ('block', 1439), ('headed', 1440), ('snows', 1441), ('spices', 1442), ('tire', 1443), ('4', 1444), ('sharing', 1445), ('bottles', 1446), ('taken', 1447), ('cube', 1448), ('leg', 1449), ('quickly', 1450), ('tray', 1451), ('fireplace', 1452), ('show', 1453), ('stool', 1454), ('tries', 1455), ('images', 1456), ('process', 1457), ('oranges', 1458), ('skyline', 1459), ('donuts', 1460), ('mean', 1461), ('diving', 1462), ('gear', 1463), ('tanks', 1464), ('skateboarders', 1465), ('jet', 1466), ('engine', 1467), ('dollhouse', 1468), ('drivers', 1469), ('wallpapered', 1470), ('standard', 1471), ('lavatory', 1472), ('giant', 1473), ('hole', 1474), ('basic', 1475), ('fixing', 1476), ('french', 1477), ('bucket', 1478), ('beard', 1479), ('grain', 1480), ('tennis', 1481), ('vintage', 1482), ('u.s.', 1483), ('pouring', 1484), ('cheese', 1485), ('scale', 1486), ('compartments', 1487), ('hanged', 1488), ('thre', 1489), ('gloves', 1490), ('kneeled', 1491), ('oats', 1492), ('babies', 1493), ('cigar', 1494), ('leashed', 1495), ('peer', 1496), ('odd', 1497), ('fully', 1498), ('borders', 1499), ('buses', 1500), ('tricycle', 1501), ('walkway', 1502), ('folding', 1503), ('mostly', 1504), ('dismantled', 1505), ('littered', 1506), ('elbow', 1507), ('hiding', 1508), ('contain', 1509), ('central', 1510), ('preparation', 1511), ('medical', 1512), ('plan', 1513), ('bearded', 1514), ('shade', 1515), ('caucasian', 1516), ('works', 1517), ('row', 1518), ('slices', 1519), ('sorting', 1520), ('buss', 1521), ('jacket', 1522), ('mother', 1523), ('carries', 1524), ('beer', 1525), ('toward', 1526), ('rests', 1527), ('radishes', 1528), ('garbage', 1529), ('chrome', 1530), ('photographs', 1531), ('snowfall', 1532), ('males', 1533), ('scuba', 1534), ('stripes', 1535), ('fish', 1536), ('eye', 1537), ('lens', 1538), ('motorcycles', 1539), ('rv', 1540), ('dicing', 1541), ('alcohol', 1542), ('measuring', 1543), ('snack', 1544), ('handicapped', 1545), ('lounging', 1546), ('rugs', 1547), ('upward', 1548), ('uses', 1549), ('doorway', 1550), ('whit', 1551), ('cuts', 1552), ('apples', 1553), ('kiwi', 1554), ('mobile', 1555), ('situated', 1556), ('player', 1557), ('racket', 1558), ('business', 1559), ('soaked', 1560), ('surgical', 1561), ('father', 1562), ('daughter', 1563), ('destroyed', 1564), ('browns', 1565), ('complete', 1566), ('traditional', 1567), ('outdoors', 1568), ('doughnut', 1569), ('drinks', 1570), ('see-through', 1571), ('mouth', 1572), ('sunglasses', 1573), ('everywhere', 1574), ('hearth', 1575), ('elephant', 1576), ('preforming', 1577), ('divers', 1578), ('siting', 1579), ('spectators', 1580), ('viewed', 1581), ('between', 1582), ('sofa', 1583), ('sill', 1584), ('directs', 1585), ('beans', 1586), ('buy', 1587), ('ice', 1588), ('cream', 1589), ('drain', 1590), ('secured', 1591), ('railing', 1592), ('neighborhood', 1593), ('vendor', 1594), ('also', 1595), ('hit', 1596), ('propeller', 1597), ('plane', 1598), ('yet', 1599), ('relaxes', 1600), ('amongst', 1601), ('machine', 1602), ('dive', 1603), ('training', 1604), ('potted', 1605), ('plant', 1606), ('frog', 1607), ('office', 1608), ('close-up', 1609), ('number', 1610), ('taxis', 1611), ('sloped', 1612), ('ceiling', 1613), ('relaxing', 1614), ('curb', 1615), ('ambulance', 1616), ('nook', 1617), ('cattle', 1618), ('worn', 1619), ('torn', 1620), ('streetlight', 1621), ('wheel', 1622), ('cones', 1623), ('crouching', 1624), ('pack', 1625), ('slicing', 1626), ('hair', 1627), ('neon', 1628), ('wheels', 1629), ('mop', 1630), ('animals', 1631), ('boarding', 1632), ('seated', 1633), ('wet', 1634), ('fruits', 1635), ('taste', 1636), ('test', 1637), ('balcony', 1638), ('scenery', 1639), ('kettles', 1640), ('materials', 1641), ('mysterious', 1642), ('bee', 1643), ('shredded', 1644), ('weight', 1645), ('neck', 1646), ('stylish', 1647), ('depicted', 1648), ('luxury', 1649), ('ventilation', 1650), ('begins', 1651), ('nose', 1652), ('grind', 1653), ('converted', 1654), ('onlookers', 1655), ('zoo', 1656), ('african', 1657), ('string', 1658), ('floral', 1659), ('designs', 1660), ('here', 1661), ('me', 1662), ('so', 1663), ('i', 1664), ('nothing', 1665), ('specific', 1666), ('write', 1667), ('talks', 1668), ('chewing', 1669), ('boarder', 1670), ('practicing', 1671), ('ramps', 1672), ('jumps', 1673), ('enclosure', 1674), ('seven', 1675), ('joker', 1676), ('cider', 1677), ('wih', 1678), ('gliding', 1679), ('community', 1680), ('connection', 1681), ('paved', 1682), ('stalls', 1683), ('mud', 1684), ('stains', 1685), ('hygiene', 1686), ('wedding', 1687), ('stages', 1688), ('facial', 1689), ('reflects', 1690), ('decor', 1691), ('surrounding', 1692), ('shared', 1693), ('cartoon', 1694), ('character', 1695), ('cord', 1696), ('deserted', 1697), ('woods', 1698), ('points', 1699), ('object', 1700), ('pulls', 1701), ('steal', 1702), ('followed', 1703), ('include', 1704), ('tight', 1705), ('digital', 1706), ('toiletry', 1707), ('bride', 1708), ('groom', 1709), ('need', 1710), ('repaired', 1711), ('graffiti', 1712), ('cloth', 1713), ('electronic', 1714), ('playfully', 1715), ('laptops', 1716), ('messy', 1717), ('sub', 1718), ('outdated', 1719), ('art', 1720), ('adult', 1721), ('attempting', 1722), ('feed', 1723), ('skateboards', 1724), ('cobble', 1725), ('stoned', 1726), ('gown', 1727), ('tied', 1728), ('post', 1729), ('still', 1730), ('chin', 1731), ('tea', 1732), ('smile', 1733), ('flowered', 1734), ('hook', 1735), ('miscellaneous', 1736), ('shoulder', 1737), ('oval', 1738), ('free', 1739), ('backseat', 1740), ('apron', 1741), ('trunk', 1742), ('implements', 1743), ('patio', 1744), ('frame', 1745), ('mess', 1746), ('christmas', 1747), ('carriage', 1748), ('placemat', 1749), ('mountains', 1750), ('pickup', 1751), ('packed', 1752), ('tightly', 1753), ('line', 1754), ('toilets', 1755), ('medieval', 1756), ('directly', 1757), ('dryer', 1758), ('glove', 1759), ('decal', 1760), ('husky', 1761), ('freezer', 1762), ('birds', 1763), ('pants', 1764), ('feeds', 1765), ('sample', 1766), ('puddle', 1767), ('stirring', 1768), ('miniature', 1769), ('stirs', 1770), ('needing', 1771), ('repair', 1772), ('certainly', 1773), ('steps', 1774), ('knifes', 1775), ('hung', 1776), ('magnetic', 1777), ('plays', 1778), ('catsup', 1779), ('teapot', 1780), ('knives', 1781), ('balance', 1782), ('stunt', 1783), ('overly', 1784), ('tankless', 1785), ('sees', 1786), ('smoke', 1787), ('speckled', 1788), ('electronics', 1789), ('lake', 1790), ('debris', 1791), ('grime', 1792), ('pastry', 1793), ('tablecloth', 1794), ('order', 1795), ('fed', 1796), ('spoonful', 1797), ('bare', 1798), ('draped', 1799), ('handle', 1800), ('jars', 1801), ('hilltop', 1802), ('tiger', 1803), ('grill', 1804), ('cooktop', 1805), ('heating', 1806), ('british', 1807), ('hockey', 1808), ('stick', 1809), ('great', 1810), ('railroad', 1811), ('attire', 1812), ('tow', 1813), ('residence', 1814), ('scheme', 1815), ('tools', 1816), ('plugged', 1817), ('simple', 1818), ('feel', 1819), ('poor', 1820), ('framed', 1821), ('book', 1822), ('vase', 1823), ('plants', 1824), ('porch', 1825), ('move', 1826), ('youth', 1827), ('automobile', 1828), ('currently', 1829), ('headphones', 1830), ('observing', 1831), ('feeding', 1832), ('ponytail', 1833), ('model', 1834), ('zebra', 1835), ('library', 1836), ('whirlpool', 1837), ('candles', 1838), ('intricate', 1839), ('colors', 1840), ('arts', 1841), ('crafts', 1842), ('chimney', 1843), ('cooked', 1844), ('flames', 1845), ('sporting', 1846), ('event', 1847), ('knot', 1848), ('gathers', 1849), ('treat', 1850), ('electrical', 1851), ('wiring', 1852), ('finished', 1853), ('orders', 1854), ('architectural', 1855), ('elements', 1856), ('skin', 1857), ('photographing', 1858), ('showcasing', 1859), ('ugly', 1860), ('contemporary', 1861), ('aqua', 1862), ('passengers', 1863), ('exit', 1864), ('unusual', 1865), ('cupcake', 1866), ('stripped', 1867), ('jewelry', 1868), ('snowboarding', 1869), ('depart', 1870), ('spray', 1871), ('words', 1872), ('touch', 1873), ('faucets', 1874), ('mom', 1875), ('sling', 1876), ('cupcakes', 1877), ('luxurious', 1878), ('retail', 1879), ('blinds', 1880), ('local', 1881), ('straddling', 1882), ('dinning', 1883), ('most', 1884), ('likely', 1885), ('adjoining', 1886), ('painting', 1887), ('culinary', 1888), ('styrofoam', 1889), ('stoves', 1890), ('extensive', 1891), ('amount', 1892), ('peppers', 1893), ('swimmers', 1894), ('cleaner', 1895), ('mixer', 1896), ('second', 1897), ('eyeing', 1898), ('load', 1899), ('photoshopped', 1900), ('clown', 1901), ('track', 1902), ('progress', 1903), ('exercising', 1904), ('drier', 1905), ('milking', 1906), ('funny', 1907), ('faces', 1908), ('parasol', 1909), ('structure', 1910), ('pedal', 1911), ('cab', 1912), ('aprons', 1913), ('china', 1914), ('wears', 1915), ('life', 1916), ('representation', 1917), ('devices', 1918), ('oceans', 1919), ('tranquil', 1920), ('bird', 1921), ('wash', 1922), ('pedestals', 1923), ('ceilings', 1924), ('tinted', 1925), ('pottery', 1926), ('rubbing', 1927), ('stripe', 1928), ('indian', 1929), ('flame', 1930), ('stuff', 1931), ('stem', 1932), ('rose', 1933), ('bathrobe', 1934), ('pauses', 1935), ('prepped', 1936), ('edges', 1937), ('teal', 1938), ('holders', 1939), ('put', 1940), ('kitchenette', 1941), ('businessmen', 1942), ('presentation', 1943), ('squats', 1944), ('cuddling', 1945), ('cowboy', 1946), ('leaves', 1947), ('paw', 1948), ('prints', 1949), ('docked', 1950), ('curved', 1951), ('speeding', 1952), ('primitive', 1953), ('celery', 1954), ('bricked', 1955), ('swimming', 1956), ('shows', 1957), ('motorcyclists', 1958), ('well-lit', 1959), ('array', 1960), ('chute', 1961), ('toa', 1962), ('beginning', 1963), ('hairless', 1964), ('vases', 1965), ('shore', 1966), ('rearing', 1967), ('attempts', 1968), ('nuzzle', 1969), ('party', 1970), ('nuzzling', 1971), ('dirt', 1972), ('taped', 1973), ('remodeling', 1974), ('chopping', 1975), ('globe', 1976), ('shopped', 1977), ('cover', 1978), ('recipe', 1979), ('penn', 1980), ('canopy', 1981), ('maroon', 1982), ('perching', 1983), ('make', 1984), ('espresso', 1985), ('vibrant', 1986), ('abstract', 1987), ('prepping', 1988), ('prior', 1989), ('executing', 1990), ('bouncing', 1991), ('floored', 1992), ('range', 1993), ('ripened', 1994), ('weird', 1995), ('form', 1996), ('pendant', 1997), ('illuminate', 1998), ('studio', 1999), ('minimal', 2000), ('helmets', 2001), ('cellphone', 2002), ('direction', 2003), ('upright', 2004), ('leaned', 2005), ('furnishing', 2006), ('short', 2007), ('skating', 2008), ('connected', 2009), ('potatoes', 2010), ('dock', 2011), ('cruises', 2012), ('competitors', 2013), ('barge', 2014), ('wheeling', 2015), ('laughing', 2016), ('rows', 2017), ('looked', 2018), ('would', 2019), ('mashed', 2020), ('doubledecker', 2021), ('complex', 2022), ('selfies', 2023), ('themselves', 2024), ('tabby', 2025), ('chopped', 2026), ('uniform', 2027), ('trimmed', 2028), ('compartment', 2029), ('licking', 2030), ('milks', 2031), ('columns', 2032), ('pushing', 2033), ('place', 2034), ('vacant', 2035), ('eclectic', 2036), ('cafeteria', 2037), ('daylight', 2038), ('utilitarian', 2039), ('upon', 2040), ('untidy', 2041), ('entry', 2042), ('stomach', 2043), ('starting', 2044), ('kitten', 2045), ('attentively', 2046), ('ascent', 2047), ('bending', 2048), ('alike', 2049), ('backing', 2050), ('pizza', 2051), ('furry', 2052), ('goodies', 2053), ('mirrored', 2054), ('already', 2055), ('awaiting', 2056), ('highway', 2057), ('touring', 2058), ('plus', 2059), ('reclining', 2060), ('wicker', 2061), ('burnt', 2062), ('disembarking', 2063), ('circular', 2064), ('plaid', 2065), ('potential', 2066), ('foods', 2067), ('wintery', 2068), ('diamond', 2069), ('trim', 2070), ('far', 2071), ('filter', 2072), ('fashion', 2073), ('stoop', 2074), ('grinds', 2075), ('mug', 2076), ('trashcan', 2077), ('arrangements', 2078), ('add', 2079), ('garden', 2080), ('reflect', 2081), ('typing', 2082), ('temporary', 2083), ('indoors', 2084), ('pit', 2085), ('kick', 2086), ('butcher', 2087), ('collectibles', 2088), ('revealing', 2089), ('soft', 2090), ('hats', 2091), ('trough', 2092), ('artistic', 2093), ('decoration', 2094), ('mannequin', 2095), ('school', 2096), ('herding', 2097), ('trail', 2098), ('left', 2099), ('heading', 2100), ('carrier', 2101), ('fingers', 2102), ('foreground', 2103), ('brushy', 2104), ('exhaust', 2105), ('pipe', 2106), ('shetland', 2107), ('ponies', 2108), ('coral', 2109), ('rear', 2110), ('moves', 2111), ('bedside', 2112), ('almost', 2113), ('drops', 2114), ('pitcher', 2115), ('leopard', 2116), ('printed', 2117), ('toys', 2118), ('relax', 2119), ('curiously', 2120), ('climbs', 2121), ('bathrooms', 2122), ('kettle', 2123), ('eat-in', 2124), ('built-in', 2125), ('artistically', 2126), ('posters', 2127), ('tired', 2128), ('bag', 2129), ('saloon', 2130), ('overpass', 2131), ('joined', 2132), ('part', 2133), ('garb', 2134), ('metropolitan', 2135), ('bustling', 2136), ('dusk', 2137), ('rotten', 2138), ('tail', 2139), ('team', 2140), ('draft', 2141), ('someones', 2142), ('washed', 2143), ('session', 2144), ('cuddles', 2145), ('comfort', 2146), ('homeless', 2147), ('belongings', 2148), ('herds', 2149), ('africa', 2150), ('messed', 2151), ('checks', 2152), ('hoodie', 2153), ('peeing', 2154), ('huddle', 2155), ('students', 2156), ('soldier', 2157), ('bent', 2158), ('turned', 2159), ('chandelier', 2160), ('flipping', 2161), ('dough', 2162), ('seriously', 2163), ('abandoned', 2164), ('warm', 2165), ('reigns', 2166), ('type', 2167), ('meat', 2168), ('panels', 2169), ('cabinetry', 2170), ('bizarre', 2171), ('job', 2172), ('adjacent', 2173), ('robe', 2174), ('gadgets', 2175), ('avid', 2176), ('cross-country', 2177), ('snowing', 2178), ('shutter', 2179), ('military', 2180), ('buggy', 2181), ('football', 2182), ('trinkets', 2183), ('wooded', 2184), ('pasture', 2185), ('stovetop', 2186), ('peanut', 2187), ('butter', 2188), ('tattoos', 2189), ('bell', 2190), ('pepper', 2191), ('spoons', 2192), ('burner', 2193), ('beyond', 2194), ('stream', 2195), ('bow', 2196), ('washbasin', 2197), ('elderly', 2198), ('walker', 2199), ('kept', 2200), ('passed', 2201), ('muzzle', 2202), ('note', 2203), ('written', 2204), ('furnishings', 2205), ('wtih', 2206), ('desert', 2207), ('partially', 2208), ('eaten', 2209), ('tubs', 2210), ('podium', 2211), ('mans', 2212), ('rest', 2213), ('funky', 2214), ('wildly', 2215), ('print', 2216), ('brand', 2217), ('dole', 2218), ('desktop', 2219), ('artwork', 2220), ('depicting', 2221), ('monitor', 2222), ('radio', 2223), ('really', 2224), ('manner', 2225), ('helping', 2226), ('sniffing', 2227), ('larger', 2228), ('console', 2229), ('orderly', 2230), ('date', 2231), ('bay', 2232), ('magazines', 2233), ('wrench', 2234), ('donut', 2235), ('letter', 2236), ('urinating', 2237), ('poster', 2238), ('medicine', 2239), ('slender', 2240), ('nest', 2241), ('hungry', 2242), ('customers', 2243), ('unfinished', 2244), ('virtual', 2245), ('star', 2246), ('naked', 2247), ('floppy', 2248), ('idly', 2249), ('create', 2250), ('turkey', 2251), ('effect', 2252), ('flashing', 2253), ('within', 2254), ('illuminates', 2255), ('tidy', 2256), ('match', 2257), ('perched', 2258), ('visitor', 2259), ('bald', 2260), ('advanced', 2261), ('boxed', 2262), ('safety', 2263), ('goggles', 2264), ('rubber', 2265), ('possibly', 2266), ('mannequins', 2267), ('pop', 2268), ('finely', 2269), ('chops', 2270), ('statue', 2271), ('snowboarders', 2272), ('roll', 2273), ('plenty', 2274), ('boot', 2275), ('give', 2276), ('help', 2277), ('bacon', 2278), ('spinach', 2279), ('tomatoes', 2280), ('tossing', 2281), ('magazine', 2282), ('evening', 2283), ('kneading', 2284), ('phones', 2285), ('cycle', 2286), ('backward', 2287), ('handlebars', 2288), ('rested', 2289), ('arrangement', 2290), ('provide', 2291), ('environment', 2292), ('rickshaw', 2293), ('own', 2294), ('gives', 2295), ('fisherman', 2296), ('groups', 2297), ('benches', 2298), ('beers', 2299), ('multi', 2300), ('tethered', 2301), ('snowboard', 2302), ('awning', 2303), ('lamppost', 2304), ('boats', 2305), ('attachment', 2306), ('mixture', 2307), ('real', 2308), ('vitamin', 2309), ('continental', 2310), ('commuter', 2311), ('tarmac', 2312), ('outlets', 2313), ('bundt', 2314), ('3d', 2315), ('actual', 2316), ('jetliner', 2317), ('bite', 2318), ('lamps', 2319), ('cents', 2320), ('aerial', 2321), ('suits', 2322), ('baseball', 2323), ('cap', 2324), ('tying', 2325), ('t-shirt', 2326), ('drill', 2327), ('reveal', 2328), ('terrace', 2329), ('clothed', 2330), ('thinking', 2331), ('happy', 2332), ('ribbon', 2333), ('carefully', 2334), ('layout', 2335), ('cows', 2336), ('roles', 2337), ('chocolate', 2338), ('glaze', 2339), ('int', 2340), ('tone', 2341), ('harbor', 2342), ('records', 2343), ('chick', 2344), ('fist', 2345), ('modeled', 2346), ('airliner', 2347), ('police', 2348), ('port', 2349), ('chicken', 2350), ('sunshine', 2351), ('centered', 2352), ('advertisement', 2353), ('colt', 2354), ('settings', 2355), ('thats', 2356), ('landing', 2357), ('rabbit', 2358), ('persons', 2359), ('houses', 2360), ('sewing', 2361), ('peering', 2362), ('puppy', 2363), ('leafy', 2364), ('awake', 2365), ('umbrealla', 2366), ('isle', 2367), ('structures', 2368), ('brake', 2369), ('helps', 2370), ('powder', 2371), ('swing', 2372), ('marina', 2373), ('tux', 2374), ('views', 2375), ('frosted', 2376), ('hauls', 2377), ('luggage', 2378), ('dolly', 2379), ('ups', 2380), ('distorted', 2381), ('burners', 2382), ('tossed', 2383), ('stroller', 2384), ('shops', 2385), ('patch', 2386), ('massive', 2387), ('components', 2388), ('petting', 2389), ('adorns', 2390), ('projects', 2391), ('twelve', 2392), ('pulled', 2393), ('roller', 2394), ('slab', 2395), ('law', 2396), ('enforcement', 2397), ('picking', 2398), ('privacy', 2399), ('notebook', 2400), ('dots', 2401), ('handlebar', 2402), ('artfully', 2403), ('n', 2404), ('6', 2405), ('approaches', 2406), ('policeman', 2407), ('higher', 2408), ('than', 2409), ('clouds', 2410), ('sunlit', 2411), ('mixing', 2412), ('bark', 2413), ('collar', 2414), ('similar', 2415), ('patterns', 2416), ('gets', 2417), ('walked', 2418), ('dispensers', 2419), ('mural', 2420), ('staircase', 2421), ('chalkboard', 2422), ('thread', 2423), ('needles', 2424), ('chalk', 2425), ('ahead', 2426), ('heavy', 2427), ('concrete', 2428), ('heights', 2429), ('sorts', 2430), ('costumed', 2431), ('employee', 2432), ('minutes', 2433), ('aa', 2434), ('peaking', 2435), ('giraffe', 2436), ('elegantly', 2437), ('designed', 2438), ('either', 2439), ('pedestrian', 2440), ('rock', 2441), ('docks', 2442), ('meters', 2443), ('busily', 2444), ('file', 2445), ('officer', 2446), ('sail', 2447), ('giraffes', 2448), ('ginger', 2449), ('adjustable', 2450), ('magnifying', 2451), ('penguins', 2452), ('penguin', 2453), ('theme', 2454), ('appointed', 2455), ('machinery', 2456), ('expired', 2457), ('spot', 2458), ('series', 2459), ('eat', 2460), ('computers', 2461), ('should', 2462), ('arriving', 2463), ('departing', 2464), ('maple', 2465), ('caught', 2466), ('blanket', 2467), ('oak', 2468), ('institutional', 2469), ('electric', 2470), ('gravel', 2471), ('oin', 2472), ('suv', 2473), ('even', 2474), ('frozen', 2475), ('tourist', 2476), ('broccoli', 2477), ('probably', 2478), ('somewhere', 2479), ('europe', 2480), ('feathers', 2481), ('lovely', 2482), ('blond', 2483), ('surround', 2484), ('tracks', 2485), ('depot', 2486), ('taxi', 2487), ('medium', 2488), ('overview', 2489), ('10', 2490), ('speed', 2491), ('kinds', 2492), ('muslim', 2493), ('interviewed', 2494), ('>', 2495), ('see', 2496), ('walk-in', 2497), ('tattoo', 2498), ('pedals', 2499), ('slide', 2500), ('handing', 2501), ('column', 2502), ('cookie', 2503), ('spoon', 2504), ('sheet', 2505), ('clearing', 2506), ('stairwell', 2507), ('partial', 2508), ('piercing', 2509), ('kitcehn', 2510), ('squared', 2511), ('hazy', 2512), ('efficiency', 2513), ('upscale', 2514), (';', 2515), ('flies', 2516), ('underpass', 2517), ('dangling', 2518), ('ten', 2519), ('steer', 2520), ('length', 2521), ('oil', 2522), ('magnets', 2523), ('graduates', 2524), ('skatepark', 2525), ('start', 2526), ('beverage', 2527), ('served', 2528), ('texting', 2529), ('apart', 2530), ('seasonings', 2531), ('world', 2532), ('coastal', 2533), ('sailing', 2534), ('ships', 2535), ('waters', 2536), ('stir', 2537), ('fry', 2538), ('map', 2539), ('worker', 2540), ('toolbox', 2541), ('photographer', 2542), ('drawn', 2543), ('towing', 2544), ('disgusting', 2545), ('stunts', 2546), ('mountainous', 2547), ('paddles', 2548), ('ducks', 2549), ('swim', 2550), ('cans', 2551), ('news', 2552), ('trimmings', 2553), ('more', 2554), ('entering', 2555), ('sips', 2556), ('companion', 2557), ('salad', 2558), ('lifted', 2559), ('ajar', 2560), ('rolling', 2561), ('surfs', 2562), ('shaggy', 2563), ('comes', 2564), ('choices', 2565), ('trains', 2566), ('both', 2567), ('youngsters', 2568), ('lacrosse', 2569), ('players', 2570), ('grooming', 2571), ('themself', 2572), ('sunning', 2573), ('itself', 2574), ('t', 2575), ('ale', 2576), ('driveway', 2577), ('cages', 2578), ('vaulted', 2579), ('nets', 2580), ('wit', 2581), ('ha', 2582), ('beat', 2583), ('program', 2584), ('trio', 2585), ('liquid', 2586), ('grinder', 2587), ('dense', 2588), ('dilapidated', 2589), ('mold', 2590), ('damage', 2591), ('hip', 2592), ('forefront', 2593), ('boogie', 2594), ('hillside', 2595), ('ends', 2596), ('cosmetics', 2597), ('housing', 2598), ('surboard', 2599), ('shelving', 2600), ('unpacked', 2601), ('separating', 2602), ('airport', 2603), ('teaching', 2604), ('how', 2605), ('california', 2606), ('route', 2607), ('throughout', 2608), ('antiques', 2609), ('rafters', 2610), ('cramped', 2611), ('melon', 2612), ('ribbons', 2613), ('blows', 2614), ('fedora', 2615), ('demonic', 2616), ('mime', 2617), ('nut', 2618), ('cgi', 2619), ('stage', 2620), ('cobblestone', 2621), ('kitty', 2622), ('auto', 2623), ('legged', 2624), ('stairway', 2625), ('beanie', 2626), ('son', 2627), ('hovering', 2628), ('mixed', 2629), ('soiled', 2630), ('pillars', 2631), ('dessert', 2632), ('finding', 2633), ('stepping', 2634), ('do', 2635), ('cookies', 2636), ('provides', 2637), ('convenience', 2638), ('any', 2639), ('cork', 2640), ('rails', 2641), ('kennel', 2642), ('feather', 2643), ('walled', 2644), ('heater', 2645), ('famous', 2646), ('actor', 2647), ('you', 2648), ('first', 2649), ('aid', 2650), ('kit', 2651), ('cluster', 2652), ('coin', 2653), ('slim', 2654), ('hog', 2655), ('duster', 2656), ('blowing', 2657), ('seemingly', 2658), ('remaining', 2659), ('exiting', 2660), ('feast', 2661), ('browse', 2662), ('every', 2663), ('selling', 2664), ('screwdriver', 2665), ('peeling', 2666), ('snacks', 2667), ('pen', 2668), ('finish', 2669), ('affixed', 2670), ('straps', 2671), ('cruise', 2672), ('ship', 2673), ('portion', 2674), ('muddy', 2675), ('reporter', 2676), ('makeshift', 2677), ('motors', 2678), ('depicts', 2679), ('salmon', 2680), ('pattered', 2681), ('log', 2682), ('oars', 2683), ('pick', 2684), ('wife', 2685), ('marbled', 2686), ('throws', 2687), ('crown', 2688), ('indicating', 2689), ('allowed', 2690), ('love', 2691), ('doodling', 2692), ('runway', 2693), ('bought', 2694), ('nighttime', 2695), ('inspects', 2696), ('stating', 2697), ('ferris', 2698), ('enthusiasts', 2699), ('sleek', 2700), ('animation', 2701), ('figures', 2702), ('airplanes', 2703), ('kneels', 2704), ('motorized', 2705), ('sittign', 2706), ('care', 2707), ('skiies', 2708), ('goofy', 2709), ('cakes', 2710), ('tablet', 2711), ('our', 2712), ('streets', 2713), ('sliced', 2714), ('toasted', 2715), ('angel', 2716), ('wild', 2717), ('rowing', 2718), ('combing', 2719), ('propane', 2720), ('desserts', 2721), ('frosting', 2722), ('animated', 2723), ('learn', 2724), ('overstuffed', 2725), ('sharpening', 2726), ('radiator', 2727), ('onions', 2728), ('easy', 2729), ('nail', 2730), ('salon', 2731), ('throw', 2732), ('sad', 2733), ('recording', 2734), ('peel', 2735), ('fetch', 2736), ('decorative', 2737), ('stops', 2738), ('rusted', 2739), ('busted', 2740), ('catching', 2741), ('chasing', 2742), ('bakes', 2743), ('redone', 2744), ('washington', 2745), ('monument', 2746), ('conditions', 2747), ('climbing', 2748), ('tart', 2749), ('pass', 2750), ('unique', 2751), ('saying', 2752), ('carpets', 2753), ('custom', 2754), ('workshop', 2755), ('pillow', 2756), ('black-and-white', 2757), ('crow', 2758), ('beet', 2759), ('bikini', 2760), ('crash', 2761), ('emergency', 2762), ('fryer', 2763), ('snowboards', 2764), ('rundown', 2765), ('grilling', 2766), ('delivering', 2767), ('dude', 2768), ('dumb', 2769), ('ratchet', 2770), ('ass', 2771), ('papers', 2772), ('whose', 2773), ('glassware', 2774), ('sharpener', 2775), ('suitcase', 2776), ('server', 2777), ('pigeon', 2778), ('could', 2779), ('change', 2780), ('thin', 2781), ('dashboard', 2782), ('expensive', 2783), ('chase', 2784), ('beauty', 2785), ('plating', 2786), ('delicious', 2787), ('gourmet', 2788), ('guest', 2789), ('delivery', 2790), ('spill', 2791), ('mark', 2792), ('chinese', 2793), ('aircraft', 2794), ('unloading', 2795), ('carving', 2796), ('curled', 2797), ('decorating', 2798), ('cop', 2799), ('c', 2800), ('ar', 2801), ('spiky', 2802), ('womans', 2803), ('upper', 2804), ('wall-mounted', 2805), ('crouched', 2806), ('hidden', 2807), ('beams', 2808), ('desks', 2809), ('mechanic', 2810), ('say', 2811), (\"n't\", 2812), ('manning', 2813), ('skies', 2814), ('operating', 2815), ('officers', 2816), ('mint', 2817), ('fellow', 2818), ('she', 2819), ('charming', 2820), ('among', 2821), ('installed', 2822), ('paneling', 2823), ('bin', 2824), ('letting', 2825), ('pull', 2826), ('shell', 2827), ('terminal', 2828), ('carry', 2829), ('trolley', 2830), ('posed', 2831), ('greens', 2832), ('rainbow', 2833), ('fixture', 2834), ('celebratory', 2835), ('rounded', 2836), ('human', 2837), ('hairbrush', 2838), ('flatbed', 2839), ('glassed', 2840), ('shuttle', 2841), ('graphic', 2842), ('puts', 2843), ('sauce', 2844), ('asia', 2845), ('bubbles', 2846), ('pasta', 2847), ('tells', 2848), ('noodles', 2849), ('fun', 2850), ('italian', 2851), ('sausages', 2852), ('meals', 2853), ('horseback', 2854), ('recreational', 2855), ('surprised', 2856), ('cloud', 2857), ('we', 2858), ('crate', 2859), ('google', 2860), ('contents', 2861), ('bins', 2862), ('spaces', 2863), ('pencil', 2864), ('stopping', 2865), ('suspended', 2866), ('wand', 2867), ('puppies', 2868), ('feminine', 2869), ('scaffolding', 2870), ('enter', 2871), ('o', 2872), (\"'\", 2873), ('signal', 2874), ('chickens', 2875), ('freshly', 2876), ('teenager', 2877), ('adjusts', 2878), ('club', 2879), ('sells', 2880), ('houseplant', 2881), ('fixed', 2882), ('cute', 2883), ('shine', 2884), ('downstairs', 2885), ('exhausted', 2886), ('macaroni', 2887), ('hose', 2888), ('pumping', 2889), ('fuel', 2890), ('repairing', 2891), ('blur', 2892), ('placing', 2893), ('flys', 2894), ('gun', 2895), ('grinding', 2896), ('size', 2897), ('shampoo', 2898), ('showerhead', 2899), ('listening', 2900), ('downhill', 2901), ('snow-capped', 2902), ('converse', 2903), ('roadside', 2904), ('fastened', 2905), ('lazily', 2906), ('retro', 2907), ('combined', 2908), ('av', 2909), ('rags', 2910), ('packages', 2911), ('tab', 2912), ('vacuum', 2913), ('pleasure', 2914), ('vacation', 2915), ('fifties', 2916), ('playful', 2917), ('lounges', 2918), ('sprayer', 2919), ('tabletop', 2920), ('teen', 2921), ('gates', 2922), ('flown', 2923), ('entree', 2924), ('skatebaord', 2925), ('legos', 2926), ('official', 2927), ('condition', 2928), ('kiddie', 2929), ('playroom', 2930), ('except', 2931), ('comb', 2932), ('scratch', 2933), ('surfaces', 2934), ('corn', 2935), ('cycling', 2936), ('kittens', 2937), ('xbox', 2938), ('controller', 2939), ('underwear', 2940), ('automobiles', 2941), ('dyed', 2942), ('ramen', 2943), ('japan', 2944), ('hanger', 2945), ('taco', 2946), ('junk', 2947), ('railings', 2948), ('smokes', 2949), ('torso', 2950), ('morning', 2951), ('retaining', 2952), ('fireman', 2953), ('silhouettes', 2954), ('pine', 2955), ('roadway', 2956), ('unit', 2957), ('patrols', 2958), ('slow', 2959), ('pace', 2960), ('toddlers', 2961), ('changes', 2962), ('pitchers', 2963), ('canisters', 2964), ('performs', 2965), ('slot', 2966), ('loft', 2967), ('clutches', 2968), ('cel', 2969), ('dash', 2970), ('fighter', 2971), ('stretches', 2972), ('wind', 2973), ('shield', 2974), ('split', 2975), ('sections', 2976), ('section', 2977), ('organ', 2978), ('infront', 2979), ('dated', 2980), ('supports', 2981), ('drum', 2982), ('circle', 2983), ('crust', 2984), ('follows', 2985), ('planes', 2986), ('fill', 2987), ('hangar', 2988), ('smart', 2989), ('fried', 2990), ('peeled', 2991), ('egg', 2992), ('shells', 2993), ('steaming', 2994), ('modest', 2995), ('beds', 2996), ('blankets', 2997), ('signaling', 2998), ('factory', 2999), ('turquoise', 3000), ('convex', 3001), ('general', 3002), ('polka', 3003), ('dot', 3004), ('uniforms', 3005), ('waitress', 3006), ('grocery', 3007), ('better', 3008), ('signals', 3009), ('garland', 3010), ('fits', 3011), ('perfectly', 3012), ('details', 3013), ('stoplight', 3014), ('museum', 3015), ('steep', 3016), ('soaps', 3017), ('classroom', 3018), ('sandals', 3019), ('vest', 3020), ('linoleum', 3021), ('grounds', 3022), ('peels', 3023), ('story', 3024), ('rink', 3025), ('soda', 3026), ('abundance', 3027), ('marching', 3028), ('directing', 3029), ('generated', 3030), ('herbs', 3031), ('eggs', 3032), ('pail', 3033), ('helmeted', 3034), ('positioned', 3035), ('met', 3036), ('film', 3037), ('straw', 3038), ('thing', 3039), ('outfitted', 3040), ('trimming', 3041), ('selection', 3042), ('cookbook', 3043), ('draws', 3044), ('rendering', 3045), ('veggies', 3046), ('dresser', 3047), ('litter', 3048), ('produce', 3049), ('spots', 3050), ('glow', 3051), ('filming', 3052), ('burgundy', 3053), ('president', 3054), ('obama', 3055), ('microphone', 3056), ('sandwich', 3057), ('dripping', 3058), ('blood', 3059), ('glimpse', 3060), ('text', 3061), ('gang', 3062), ('ted', 3063), ('aluminum', 3064), ('slanted', 3065), ('concept', 3066), ('disheveled', 3067), ('suspenders', 3068), ('hay', 3069), ('masks', 3070), ('oncoming', 3071), ('money', 3072), ('flow', 3073), ('extremely', 3074), ('nude', 3075), ('sale', 3076), ('tagged', 3077), ('join', 3078), ('convoy', 3079), ('barbecue', 3080), ('sauces', 3081), ('midst', 3082), ('site', 3083), ('roaming', 3084), ('thanksgiving', 3085), ('figurine', 3086), ('santa', 3087), ('claus', 3088), ('windy', 3089), ('patriotic', 3090), (\"'m\", 3091), ('bouquet', 3092), ('steering', 3093), ('crosses', 3094), ('ring', 3095), ('grouping', 3096), ('somewhat', 3097), ('fork', 3098), ('bushes', 3099), ('walkways', 3100), ('offers', 3101), ('opportunity', 3102), ('adorned', 3103), ('baker', 3104), ('baked', 3105), ('lavender', 3106), ('visitors', 3107), ('batch', 3108), ('siding', 3109), ('bundle', 3110), ('classy', 3111), ('derby', 3112), ('shack', 3113), ('th', 3114), ('amish', 3115), ('shades', 3116), ('present', 3117), ('pale', 3118), ('appealing', 3119), ('boiling', 3120), ('decrepit', 3121), ('tattered', 3122), ('hangings', 3123), ('solo', 3124), ('functional', 3125), ('property', 3126), ('needed', 3127), ('collage', 3128), ('wrought', 3129), ('cleans', 3130), ('beaded', 3131), ('sideways', 3132), ('break', 3133), ('devoid', 3134), ('en', 3135), ('suite', 3136), ('faced', 3137), ('soapy', 3138), ('sided', 3139), ('herd', 3140), ('divider', 3141), ('expression', 3142), ('mouse', 3143), ('novel', 3144), ('spotted', 3145), ('quilt', 3146), ('soaking', 3147), ('graffitti', 3148), ('focusing', 3149), ('bulls', 3150), ('tot', 3151), ('make-up', 3152), ('consumed', 3153), ('hotplate', 3154), ('toasters', 3155), ('pigeons', 3156), ('travels', 3157), ('attic', 3158), ('l-shaped', 3159), ('pointing', 3160), ('cardigan', 3161), ('hunches', 3162), ('harnesses', 3163), ('farming', 3164), ('american', 3165), (':', 3166), ('sparrow', 3167), ('labeled', 3168), ('providing', 3169), ('straight', 3170), ('check', 3171), ('petals', 3172), ('vertical', 3173), ('hitched', 3174), ('necktie', 3175), ('wear', 3176), ('bicycling', 3177), ('traveler', 3178), ('staff', 3179), ('seperate', 3180), ('shavings', 3181), ('lunges', 3182), ('barn', 3183), ('coast', 3184), ('extending', 3185), ('filed', 3186), ('quite', 3187), ('bit', 3188), ('multicolor', 3189), ('galley', 3190), ('cucumbers', 3191), ('third', 3192), ('cutter', 3193), ('off-white', 3194), ('sandwiches', 3195), ('ornaments', 3196), ('pug', 3197), ('fur', 3198), ('applying', 3199), ('brakes', 3200), ('cops', 3201), ('divided', 3202), ('cubicles', 3203), ('pouch', 3204), ('backyard', 3205), ('backed', 3206), ('entirely', 3207), ('snowboarder', 3208), ('breads', 3209), ('clocks', 3210), ('clad', 3211), ('balding', 3212), ('meeting', 3213), ('protector', 3214), ('bites', 3215), ('task', 3216), ('force', 3217), ('monitors', 3218), ('corridor', 3219), ('stacks', 3220), ('venue', 3221), ('ladder', 3222), ('extended', 3223), ('glare', 3224), ('common', 3225), ('tour', 3226), ('army', 3227), ('cream-colored', 3228), ('oriental', 3229), ('instructing', 3230), ('grand', 3231), ('squished', 3232), ('leads', 3233), ('playground', 3234), ('manual', 3235), ('reception', 3236), ('basins', 3237), ('timer', 3238), ('cell-phone', 3239), ('doubles', 3240), ('trashcans', 3241), ('camping', 3242), ('trays', 3243), ('eatery', 3244), ('youths', 3245), ('arched', 3246), ('sophisticated', 3247), ('statement', 3248), ('textured', 3249), ('mature', 3250), ('snail', 3251), ('foraging', 3252), ('chop', 3253), ('grabbing', 3254), ('gingerbread', 3255), ('wrecked', 3256), ('non', 3257), ('accident', 3258), ('beads', 3259), ('paperwork', 3260), ('us', 3261), ('rich', 3262), ('handbag', 3263), ('perimeter', 3264), ('grater', 3265), ('substance', 3266), ('plumbing', 3267), ('summer', 3268), ('refreshments', 3269), ('parts', 3270), ('layer', 3271), ('olives', 3272), ('calmly', 3273), ('paintbrush', 3274), ('shaking', 3275), ('too', 3276), ('pastel', 3277), ('senior', 3278), ('citizen', 3279), ('enjoys', 3280), ('pokes', 3281), ('sort', 3282), ('tool', 3283), ('flip', 3284), ('mason', 3285), ('neckties', 3286), ('had', 3287), ('grating', 3288), ('tote', 3289), ('navigates', 3290), ('presents', 3291), ('portable', 3292), ('artist', 3293), ('paints', 3294), ('strewn', 3295), ('investigate', 3296), ('skates', 3297), ('ducky', 3298), ('audience', 3299), ('pizzas', 3300), ('baking', 3301), ('sheets', 3302), ('archway', 3303), ('cobbled', 3304), ('rise', 3305), ('discussing', 3306), ('alcove', 3307), ('hairdryer', 3308), ('rural', 3309), ('restaraunt', 3310), ('dozen', 3311), ('approaching', 3312), ('observe', 3313), ('flipped', 3314), ('layered', 3315), ('storing', 3316), ('telling', 3317), ('speaking', 3318), ('decorates', 3319), ('skillet', 3320), ('constructing', 3321), ('fron', 3322), ('calico', 3323), ('indicates', 3324), ('must', 3325), ('viewer', 3326), ('jackets', 3327), ('bookcase', 3328), ('packing', 3329), ('trip', 3330), ('cellular', 3331), ('device', 3332), ('vegetarian', 3333), ('touching', 3334), ('sprinkles', 3335), ('bathtub/shower', 3336), ('deck', 3337), ('tub/shower', 3338), ('fluorescent', 3339), ('darth', 3340), ('vader', 3341), ('unmade', 3342), ('individuals', 3343), ('coolers', 3344), ('starbucks', 3345), ('bookshelf', 3346), ('hotdogs', 3347), ('tights', 3348), ('historic', 3349), ('backs', 3350), ('heated', 3351), ('families', 3352), ('wading', 3353), ('sprinkled', 3354), ('pies', 3355), ('card', 3356), ('paddle', 3357), ('matter', 3358), ('union', 3359), ('speech', 3360), ('peach', 3361), ('inflatable', 3362), ('heads', 3363), ('bakery', 3364), ('adds', 3365), ('iwth', 3366), ('1950', 3367), ('tends', 3368), ('lemon', 3369), ('skirt', 3370), ('forrest', 3371), ('sweat', 3372), ('spigot', 3373), ('eats', 3374), ('barber', 3375), ('period', 3376), ('updated', 3377), ('tongs', 3378), ('whisk', 3379), ('lighter', 3380), ('opener', 3381), ('says', 3382), ('music', 3383), ('awaits', 3384), ('waling', 3385), ('paddling', 3386), ('duck', 3387), ('soon', 3388), ('much', 3389), ('bearing', 3390), ('protesting', 3391), ('marker', 3392), ('pie', 3393), ('oar', 3394), ('motorbikes', 3395), ('casual', 3396), ('riverbank', 3397), ('classic', 3398), ('leaf', 3399), ('guard', 3400), ('banner', 3401), ('wording', 3402), ('2012', 3403), ('address', 3404), ('interacting', 3405), ('motorcyclist', 3406), ('scarf', 3407), ('parrots', 3408), ('sterile', 3409), ('weeds', 3410), ('piled', 3411), ('drop', 3412), ('rubbish', 3413), ('war', 3414), ('ticket', 3415), ('your', 3416), ('couches', 3417), ('maid', 3418), ('infant', 3419), ('may', 3420), ('hides', 3421), ('hurdle', 3422), ('otherwise', 3423), ('eagle', 3424), ('grate', 3425), ('fisheye', 3426), ('sails', 3427), ('lowered', 3428), ('led', 3429), ('vice', 3430), ('grip', 3431), ('shots', 3432), ('messing', 3433), ('shallow', 3434), ('underside', 3435), ('once', 3436), ('protestors', 3437), ('coals', 3438), ('rocks', 3439), ('enormous', 3440), ('tricky', 3441), ('drift', 3442), ('pumpkin', 3443), ('seeds', 3444), ('arranging', 3445), ('elevated', 3446), ('shit', 3447), ('stained', 3448), ('filth', 3449), ('boating', 3450), ('course', 3451), ('transporting', 3452), ('shoving', 3453), ('bookcases', 3454), ('handstand', 3455), ('recessed', 3456), ('photography', 3457), ('creek', 3458), ('laugh', 3459), ('wheeler', 3460), ('slicer', 3461), ('flush', 3462), ('position', 3463), ('mustache', 3464), ('sweeping', 3465), ('letters', 3466), ('soaring', 3467), ('tractor', 3468), ('backside', 3469), ('naval', 3470), ('shoe', 3471), ('ranges', 3472), ('sumo', 3473), ('wrestler', 3474), ('leaping', 3475), ('carrots', 3476), ('mats', 3477), ('raised', 3478), ('sepia-toned', 3479), ('wetsuits', 3480), ('pairs', 3481), ('completely', 3482), ('now', 3483), ('protective', 3484), ('couples', 3485), ('buttons', 3486), ('herded', 3487), ('scrubber', 3488), ('tower', 3489), ('panorama', 3490), ('pipes', 3491), ('trailing', 3492), ('prep', 3493), ('crouch', 3494), ('rises', 3495), ('crude', 3496), ('jobs', 3497), ('actors', 3498), ('tint', 3499), ('murals', 3500), ('happily', 3501), ('vodka', 3502), ('convertible', 3503), ('volkswagon', 3504), ('waste', 3505), ('tandem', 3506), ('flag', 3507), ('decorate', 3508), ('arcade', 3509), ('suitcases', 3510), ('icing', 3511), ('lean', 3512), ('toss', 3513), ('shift', 3514), ('nuts', 3515), ('america', 3516), ('scallions', 3517), ('fallen', 3518), ('parka', 3519), ('servings', 3520), ('razor', 3521), ('constructed', 3522), ('early', 3523), ('stance', 3524), ('holiday', 3525), ('caption', 3526), ('breaking', 3527), ('tram', 3528), ('sealed', 3529), ('shady', 3530), ('forested', 3531), ('landscape', 3532), ('fat', 3533), ('hamburger', 3534), ('semi', 3535), ('cozy', 3536), ('muscles', 3537), ('basement', 3538), ('distant', 3539), ('baggage', 3540), ('loaf', 3541), ('kimono', 3542), ('conventional', 3543), ('stable', 3544), ('tilted', 3545), ('pane', 3546), ('conversing', 3547), ('racquet', 3548), ('ridden', 3549), ('leave', 3550), ('crossword', 3551), ('bathed', 3552), ('wheelchair', 3553), ('tin', 3554), ('angles', 3555), ('performers', 3556), ('india', 3557), ('leather', 3558), ('volkswagen', 3559), ('napkin', 3560), ('dugout', 3561), ('3', 3562), ('countryside', 3563), ('cooker', 3564), ('parent', 3565), ('bagel', 3566), ('smashed', 3567), ('overcoat', 3568), ('underground', 3569), ('arrows', 3570), ('investigates', 3571), ('drawing', 3572), ('plated', 3573), ('goldfish', 3574), ('elaborate', 3575), ('insides', 3576), ('squash', 3577), ('overlooks', 3578), ('warmer', 3579), ('vane', 3580), ('duel', 3581), ('backpacks', 3582), ('plush', 3583), ('crab', 3584), ('frying', 3585), ('wedged', 3586), ('lighthouse', 3587), ('boring', 3588), ('races', 3589), ('canoes', 3590), ('tunnel', 3591), ('knees', 3592), ('stretched', 3593), ('piano', 3594), ('did', 3595), ('ones', 3596), ('hundred', 3597), ('years', 3598), ('ago', 3599), ('walnut', 3600), ('come', 3601), ('wile', 3602), ('pressing', 3603), ('button', 3604), ('such', 3605), ('etc', 3606), ('teams', 3607), ('rowers', 3608), ('nasty', 3609), ('fields', 3610), ('boundary', 3611), ('created', 3612), ('aging', 3613), ('cot', 3614), ('grille', 3615), ('village', 3616), ('overheard', 3617), ('sharp', 3618), ('geisha', 3619), ('canoe', 3620), ('holes', 3621), ('call', 3622), ('matches', 3623), ('deserts', 3624), ('cooling', 3625), ('carts', 3626), ('populated', 3627), ('cruiser', 3628), ('alcoholic', 3629), ('users', 3630), ('racing', 3631), ('attempt', 3632), ('highchair', 3633), ('leftovers', 3634), ('halloween', 3635), ('signage', 3636), ('kayak', 3637), ('lifting', 3638), ('shabby', 3639), ('stickers', 3640), ('cellphones', 3641), ('bleeding', 3642), ('steam', 3643), ('efficient', 3644), ('tasting', 3645), ('waiters', 3646), ('fuzzy', 3647), ('strung', 3648), ('hospital', 3649), ('future', 3650), ('contact', 3651), ('name', 3652), ('milling', 3653), ('saddle', 3654), ('uncomfortable', 3655), ('humans', 3656), ('convenient', 3657), ('often', 3658), ('faster', 3659), ('planted', 3660), ('shaves', 3661), ('shed', 3662), ('sick', 3663), ('boom', 3664), ('lettuce', 3665), ('fire-hydrant', 3666), ('late', 3667), ('laughs', 3668), ('gesture', 3669), ('eyes', 3670), ('citrus', 3671), ('camouflage', 3672), ('cases', 3673), ('hooks', 3674), ('volleyball', 3675), ('strawberry', 3676), ('descending', 3677), ('banners', 3678), ('his/her', 3679), ('establishment', 3680), ('disc', 3681), ('sons', 3682), ('mountainside', 3683), ('aquarium', 3684), ('formation', 3685), ('jockey', 3686), ('fashionable', 3687), ('representing', 3688), ('lonely', 3689), ('fenced-in', 3690), ('corral', 3691), ('rescue', 3692), ('spatula', 3693), ('shadowy', 3694), ('estate', 3695), ('ad', 3696), ('cheeseburger', 3697), ('motorboat', 3698), ('preparations', 3699), ('wii', 3700), ('shutters', 3701), ('hugging', 3702), ('vendors', 3703), ('streaming', 3704), ('coupe', 3705), ('aged', 3706), ('breasts', 3707), ('turns', 3708), ('uphill', 3709), ('stirred', 3710), ('buckled', 3711), (\"'re\", 3712), ('goose', 3713), ('point', 3714), ('...', 3715), ('crowding', 3716), ('creates', 3717), ('organization', 3718), ('pillows', 3719), ('learning', 3720), ('designated', 3721), ('remotes', 3722), ('mosaic', 3723), ('layers', 3724), ('drab', 3725), ('onion', 3726), ('windowed', 3727), ('essentials', 3728), ('formally', 3729), ('athlete', 3730), ('lab', 3731), ('brushed', 3732), ('belt', 3733), ('sleep', 3734), ('machines', 3735), ('ink', 3736), ('crushed', 3737), ('given', 3738), ('clementine', 3739), ('slips', 3740), ('jets', 3741), ('motion', 3742), ('package', 3743), ('gilded', 3744), ('let', 3745), ('deal', 3746), ('twin', 3747), ('partition', 3748), ('kingdom', 3749), ('highlights', 3750), ('foil', 3751), ('protrudes', 3752), ('payphone', 3753), ('platter', 3754), ('bake', 3755), ('yachts', 3756), ('headlights', 3757), ('fills', 3758), ('washes', 3759), ('batter', 3760), ('means', 3761), ('when', 3762), ('live', 3763), ('fit', 3764), ('flock', 3765), ('plunger', 3766), ('security', 3767), ('members', 3768), ('sleepy', 3769), ('quaint', 3770), ('grips', 3771), ('elevator', 3772), ('casserole', 3773), ('abandon', 3774), ('creepy', 3775), ('bamboo', 3776), ('renovations', 3777), ('deodorant', 3778), ('slides', 3779), ('unoccupied', 3780), ('glowing', 3781), ('handles', 3782), ('doorways', 3783), ('less', 3784), ('maneuver', 3785), ('ordinary', 3786), ('poodle', 3787), ('bubbling', 3788), ('nestled', 3789), ('studying', 3790), ('trunks', 3791), ('crowds', 3792), ('newborn', 3793), ('arabic', 3794), ('crowed', 3795), ('pc', 3796), ('lite', 3797), ('limit', 3798), ('mac', 3799), ('canning', 3800), ('barstools', 3801), ('ironing', 3802), ('practical', 3803), ('hoses', 3804), ('charge', 3805), ('lobster', 3806), ('bits', 3807), ('protruding', 3808), ('conference', 3809), ('shirted', 3810), ('mismatched', 3811), ('charger', 3812), ('bedding', 3813), ('sparkling', 3814), ('logo', 3815), ('booster', 3816), ('pump', 3817), ('inserted', 3818), ('sailboats', 3819), ('heat', 3820), ('bunt', 3821), ('skills', 3822), ('discuss', 3823), ('enough', 3824), ('figure', 3825), ('avenue', 3826), ('today', 3827), ('exhibit', 3828), ('keep', 3829), ('foodstuffs', 3830), ('overnight', 3831), ('portraits', 3832), ('feature', 3833), ('villa', 3834), ('waterfall', 3835), ('cane', 3836), ('knit', 3837), ('flags', 3838), ('swimsuits', 3839), ('spreading', 3840), ('whip', 3841), ('wetsuit', 3842), ('carcass', 3843), ('mustard', 3844), ('lingerie', 3845), ('these', 3846), ('found', 3847), ('widow', 3848), ('hamper', 3849), ('headlight', 3850), ('clings', 3851), ('visit', 3852), ('fires', 3853), ('craft', 3854), ('blaze', 3855), ('prone', 3856), ('punching', 3857), ('juice', 3858), ('directions', 3859), ('aboard', 3860), ('teaches', 3861), ('restaurants', 3862), ('wiht', 3863), ('everyone', 3864), ('ruined', 3865), ('growing', 3866), ('nick', 3867), ('knacks', 3868), ('rag', 3869), ('cooler', 3870), ('grabs', 3871), ('rearview', 3872), ('bull', 3873), ('horns', 3874), ('sticks', 3875), ('moss', 3876), ('motorcross', 3877), ('jugs', 3878), ('hero', 3879), ('pours', 3880), ('opponent', 3881), ('inviting', 3882), ('moldy', 3883), ('movie', 3884), ('theater', 3885), ('checker', 3886), ('rubs', 3887), ('recess', 3888), ('ton', 3889), ('toting', 3890), ('mounting', 3891), ('sport', 3892), ('assembly', 3893), ('patrons', 3894), ('navigating', 3895), ('raw', 3896), ('university', 3897), ('afghan', 3898), ('s', 3899), ('engaged', 3900), ('activities', 3901), ('lasagna', 3902), ('internet', 3903), ('photoshop', 3904), ('altitude', 3905), ('worked', 3906), ('springs', 3907), ('dolls', 3908), ('think', 3909), ('sinking', 3910), ('warming', 3911), ('satchel', 3912), ('arrives', 3913), ('peaks', 3914), ('quote', 3915), ('unaware', 3916), ('lobby', 3917), ('greeting', 3918), ('slate', 3919), ('bodysuit', 3920), ('marked', 3921), ('am', 3922), ('unable', 3923), ('apparently', 3924), ('turbulent', 3925), ('soldiers', 3926), ('per', 3927), ('instruction', 3928), ('beets', 3929), ('changing', 3930), ('friendly', 3931), ('frames', 3932), ('dwelling', 3933), ('sings', 3934), ('ultimate', 3935), ('bumping', 3936), ('camp', 3937), ('speakers', 3938), ('pill', 3939), ('chili', 3940), ('barb', 3941), ('bloody', 3942), ('main', 3943), ('closing', 3944), ('trench', 3945), ('elephants', 3946), ('rode', 3947), ('my', 3948), ('cereal', 3949), ('lemons', 3950), ('camper', 3951), ('fans', 3952), ('milk', 3953), ('cool', 3954), ('diaper', 3955), ('outhouse', 3956), ('lipstick', 3957), ('blending', 3958), ('ridge', 3959), ('creating', 3960), ('cleaver', 3961), ('netting', 3962), ('aisle', 3963), ('fatigues', 3964), ('detailed', 3965), ('peddling', 3966), ('pathway', 3967), ('lamb', 3968), ('cage', 3969), ('sundae', 3970), ('uncovered', 3971), ('crumpled', 3972), ('newspapers', 3973), ('numbered', 3974), ('mainly', 3975), ('mexican', 3976), ('tortillas', 3977), ('grab', 3978), ('pizzeria', 3979), ('praying', 3980), ('crystal', 3981), ('faded', 3982), ('sheep', 3983), ('tents', 3984), ('apparatus', 3985), ('net', 3986), ('modular', 3987), ('sugar', 3988), ('tosses', 3989), ('got', 3990), ('material', 3991), ('bandana', 3992), ('skulls', 3993), ('labelled', 3994), ('tags', 3995), ('grade', 3996), ('carpeted', 3997), ('calm', 3998), ('geese', 3999), ('rumpled', 4000), ('hairy', 4001), ('niche', 4002), ('staples', 4003), ('1', 4004), ('difficult', 4005), ('hoping', 4006), ('effects', 4007), ('manipulating', 4008), ('hike', 4009), ('speeds', 4010), ('colorfully', 4011), ('comforter', 4012), ('busses', 4013), ('trek', 4014), ('gentle', 4015), ('perch', 4016), ('courts', 4017), ('ensemble', 4018), ('roast', 4019), ('dry', 4020), ('cocktail', 4021), ('shaker', 4022), ('gorgeous', 4023), ('waving', 4024), ('takeoff', 4025), ('midair', 4026), ('losing', 4027), ('locks', 4028), ('safe', 4029), ('surrounds', 4030), ('dipping', 4031), ('snoozing', 4032), ('performance', 4033), ('strands', 4034), ('arranges', 4035), ('commuters', 4036), ('patrol', 4037), ('deer', 4038), ('outlet', 4039), ('utility', 4040), ('allows', 4041), ('know', 4042), ('railway', 4043), ('crying', 4044), ('sailboat', 4045), ('goat', 4046), ('yellowish', 4047), ('sneakers', 4048), ('lids', 4049), ('drapes', 4050), ('necessary', 4051), ('stored', 4052), ('patiently', 4053), ('sigh', 4054), ('await', 4055), ('somebody', 4056), ('church', 4057), ('oils', 4058), ('wiping', 4059), ('outfits', 4060), ('bottled', 4061), ('bat', 4062), ('cabs', 4063), ('comfortable', 4064), ('flushed', 4065), ('puzzled', 4066), ('bandanna', 4067), ('extreme', 4068), ('lived', 4069), ('polo', 4070), ('multi-colored', 4071), ('cityscape', 4072), ('mushrooms', 4073), ('partly', 4074), ('ans', 4075), ('pearls', 4076), ('uncut', 4077), ('bakers', 4078), ('childs', 4079), ('pond', 4080), ('checkerboard', 4081), ('side-by-side', 4082), ('congested', 4083), ('loom', 4084), ('coloring', 4085), ('ancient', 4086), ('band', 4087), ('woven', 4088), ('puffy', 4089), ('study', 4090), ('tails', 4091), ('backdrop', 4092), ('blade', 4093), ('rocky', 4094), ('outcropping', 4095), ('paris', 4096), ('slop', 4097), ('belongs', 4098), ('accompanied', 4099), ('affectionately', 4100), ('knocked', 4101), ('sticky', 4102), ('notes', 4103), ('duo', 4104), ('watermelon', 4105), ('crawling', 4106), ('handled', 4107), ('symbol', 4108), ('throwing', 4109), ('bends', 4110), ('twp', 4111), ('wines', 4112), ('skillets', 4113), ('awesome', 4114), ('homey', 4115), ('windowsill', 4116), ('tarps', 4117), ('connecting', 4118), ('capped', 4119), ('cheetah', 4120), ('statues', 4121), ('squatting', 4122), ('punch', 4123), ('hills', 4124), ('usual', 4125), ('burning', 4126), ('amid', 4127), ('sectional', 4128), ('gazing', 4129), ('tubes', 4130), ('booze', 4131), ('proper', 4132), ('cottage', 4133), ('arches', 4134), ('pressure', 4135), ('decent', 4136), ('slider', 4137), ('sampling', 4138), ('inspect', 4139), ('strips', 4140), ('cubicle', 4141), ('hovers', 4142), ('barren', 4143), ('fishing', 4144), ('towed', 4145), ('jeep', 4146), ('delta', 4147), ('airlines', 4148), ('silly', 4149), ('dice', 4150), ('excitedly', 4151), ('hong', 4152), ('kong', 4153), ('cabins', 4154), ('matress', 4155), ('handheld', 4156), ('curve', 4157), ('spare', 4158), ('label', 4159), ('cameras', 4160), ('blues', 4161), ('dotted', 4162), ('spanning', 4163), ('turban', 4164), ('bulletin', 4165), ('necessities', 4166), ('berries', 4167), ('consists', 4168), ('mugs', 4169), ('squeezed', 4170), ('para', 4171), ('whine', 4172), ('re', 4173), ('headdress', 4174), ('wet-suit', 4175), ('laminate', 4176), ('stadium', 4177), ('sisters', 4178), ('dedicated', 4179), ('plywood', 4180), ('shake', 4181), ('travelling', 4182), ('gotten', 4183), ('strawberries', 4184), ('oxen', 4185), ('autumn', 4186), ('menu', 4187), ('enters', 4188), ('white-tiled', 4189), ('framing', 4190), ('kickstand', 4191), ('crew', 4192), ('clips', 4193), ('younger', 4194), ('ca', 4195), ('tell', 4196), ('occupies', 4197), ('icebox', 4198), ('potty', 4199), ('propellors', 4200), ('plums', 4201), ('monkey', 4202), ('pod', 4203), ('vw', 4204), ('bug', 4205), ('windshield', 4206), ('owls', 4207), ('ultra', 4208), ('downward', 4209), ('artichoke', 4210), ('owl', 4211), ('monochrome', 4212), ('woodsy', 4213), ('verdant', 4214), ('liquor', 4215), ('likes', 4216), ('practice', 4217), ('why', 4218), ('scratching', 4219), ('accented', 4220), ('grouped', 4221), ('linen', 4222), ('grapes', 4223), ('grandma', 4224), ('supported', 4225), ('golf', 4226), ('l', 4227), ('seed', 4228), ('flight', 4229), ('onward', 4230), ('kiteboard', 4231), ('crumbling', 4232), ('chips', 4233), ('dancing', 4234), ('violet', 4235), ('rope', 4236), ('peacefully', 4237), ('identification', 4238), ('tag', 4239), ('civilians', 4240), ('bronco', 4241), ('sushi', 4242), ('stood', 4243), ('jar', 4244), ('dye', 4245), ('bookshelves', 4246), ('shoreline', 4247), ('wake', 4248), ('barefoot', 4249), ('!', 4250), ('topping', 4251), ('muffins', 4252), ('padded', 4253), ('microwaves', 4254), ('presenting', 4255), ('surfboarding', 4256), ('bystanders', 4257), ('checked', 4258), ('onlooker', 4259), ('companions', 4260), ('paintings', 4261), ('unusually', 4262), ('mouths', 4263), ('badminton', 4264), ('rared', 4265), ('healthy', 4266), ('excited', 4267), ('private', 4268), ('patrolling', 4269), ('shading', 4270), ('festival', 4271), ('runs', 4272), ('messages', 4273), ('anything', 4274), ('armed', 4275), ('polished', 4276), ('undergoing', 4277), ('uniformed', 4278), ('upcoming', 4279), ('wavy', 4280), ('chandeliers', 4281), ('cubby', 4282), ('feathered', 4283), ('shut', 4284), ('loading', 4285), ('spilled', 4286), ('pills', 4287), ('huddled', 4288), ('wonder', 4289), ('carried', 4290), ('eyed', 4291), ('smelling', 4292), ('contrasting', 4293), ('tomato', 4294), ('sight', 4295), ('processor', 4296), ('contraption', 4297), ('violin', 4298), ('jerseys', 4299), ('wings', 4300), ('drawings', 4301), ('resturant', 4302), ('panting', 4303), ('audio', 4304), ('stocking', 4305), ('plastered', 4306), ('tongue', 4307), ('bored', 4308), ('interested', 4309), ('easel', 4310), ('cheerful', 4311), ('muscle', 4312), ('blocking', 4313), ('action', 4314), ('zip', 4315), ('saddled', 4316), ('reins', 4317), ('mane', 4318), ('hug', 4319), ('stare', 4320), ('falcon', 4321), ('extinguisher', 4322), ('handling', 4323), ('hawk', 4324), ('prey', 4325), ('medium-sized', 4326), ('metro', 4327), ('data', 4328), ('toppings', 4329), ('respective', 4330), ('spaceous', 4331), ('then', 4332), ('normal', 4333), ('slight', 4334), ('watched', 4335), ('arrow', 4336), ('appearing', 4337), ('minivan', 4338), ('cockpit', 4339), ('begin', 4340), ('embracing', 4341), ('dummies', 4342), ('marsh', 4343), ('packaging', 4344), ('ripped', 4345), ('crooked', 4346), ('delivered', 4347), ('clause', 4348), ('smokey', 4349), ('amazing', 4350), ('solitary', 4351), ('quality', 4352), ('thick', 4353), ('parks', 4354), ('dummy', 4355), ('chubby', 4356), ('riderless', 4357), ('bubble', 4358), ('nails', 4359), ('assisting', 4360), ('spout', 4361), ('dropped', 4362), ('rice', 4363), ('speaks', 4364), ('based', 4365), ('completing', 4366), ('overweight', 4367), ('monogrammed', 4368), ('alleyway', 4369), ('adding', 4370), ('flashes', 4371), ('clay', 4372), ('simply', 4373), ('anticipation', 4374), ('mixes', 4375), ('times', 4376), ('lumber', 4377), ('return', 4378), ('additional', 4379), ('numbers', 4380), ('magnet', 4381), ('swiftly', 4382), ('prize', 4383), ('begging', 4384), ('treats', 4385), ('counter-top', 4386), ('plugs', 4387), ('instructor', 4388), ('omelet', 4389), ('articulated', 4390), ('knobs', 4391), ('sleeve', 4392), ('sold', 4393), ('extra', 4394), ('homes', 4395), ('flips', 4396), ('tortilla', 4397), ('monopoly', 4398), ('foliage', 4399), ('creation', 4400), ('fair', 4401), ('crates', 4402), ('western', 4403), ('dollop', 4404), ('replica', 4405), ('speaker', 4406), ('tube', 4407), ('catcher', 4408), ('hooded', 4409), ('lanes', 4410), ('extravagant', 4411), ('filing', 4412), ('beam', 4413), ('grains', 4414), ('carriages', 4415), ('limousine', 4416), ('camo', 4417), ('limo', 4418), ('flowery', 4419), ('sequence', 4420), ('transport', 4421), ('southern', 4422), ('tips', 4423), ('raincoat', 4424), ('ping', 4425), ('pong', 4426), ('gingham', 4427), ('lavish', 4428), ('handrail', 4429), ('fixes', 4430), ('hull', 4431), ('canal', 4432), ('rowboat', 4433), ('maintenance', 4434), ('&', 4435), ('protection', 4436), ('campers', 4437), ('velvet', 4438), ('garlic', 4439), ('bigger', 4440), ('proud', 4441), ('hatch', 4442), ('warped', 4443), ('grins', 4444), ('stretching', 4445), ('competition', 4446), ('joke', 4447), ('safely', 4448), ('tale', 4449), ('glares', 4450), ('embedded', 4451), ('plaster', 4452), ('hitter', 4453), ('umpire', 4454), ('photographic', 4455), ('sheering', 4456), ('corded', 4457), ('applied', 4458), ('w', 4459), ('shearing', 4460), ('oblong', 4461), ('locker', 4462), ('jumpsuit', 4463), ('gentlemen', 4464), ('cape', 4465), ('deckered', 4466), ('stret', 4467), ('emptying', 4468), ('toiler', 4469), ('hundreds', 4470), ('skyscrapers', 4471), ('parachute', 4472), ('floats', 4473), ('expanse', 4474), ('vessel', 4475), ('vents', 4476), ('vending', 4477), ('watery', 4478), ('wing', 4479), ('lightly', 4480), ('marketplace', 4481), ('khakis', 4482), ('prison', 4483), ('saab', 4484), ('dealership', 4485), ('ordered', 4486), ('layed', 4487), ('vines', 4488), ('shooting', 4489), ('curl', 4490), ('assembled', 4491), ('ivy', 4492), ('barking', 4493), ('grungy', 4494), ('messenger', 4495), ('fighting', 4496), ('hedge', 4497), ('sweatshirt', 4498), ('socks', 4499), ('yelling', 4500), ('chic', 4501), ('buds', 4502), ('ears', 4503), ('cay', 4504), ('tending', 4505), ('buying', 4506), ('parrot', 4507), ('clinging', 4508), ('gooey', 4509), ('vision', 4510), ('long-haired', 4511), ('brunette', 4512), ('jogging', 4513), ('merry', 4514), ('knitted', 4515), ('cuddle', 4516), ('wares', 4517), ('units', 4518), ('waterway', 4519), ('crocheted', 4520), ('birch', 4521), ('carousel', 4522), ('snuggling', 4523), ('planter', 4524), ('arrive', 4525), ('gigantic', 4526), ('eachother', 4527), ('(', 4528), ('50', 4529), ('era', 4530), (')', 4531), ('props', 4532), ('longboard', 4533), ('ipad', 4534), ('seem', 4535), ('writings', 4536), ('cuddled', 4537), ('illustration', 4538), ('deciding', 4539), ('wants', 4540), ('further', 4541), ('biting', 4542), ('trike', 4543), ('well-organized', 4544), ('brownies', 4545), ('looming', 4546), ('crouches', 4547), ('bmw', 4548), ('lodge', 4549), ('witha', 4550), ('grainy', 4551), ('rather', 4552), ('teacher', 4553), ('victorian', 4554), ('pony', 4555), ('find', 4556), ('cycles', 4557), ('understand', 4558), ('language', 4559), ('policemen', 4560), ('freeway', 4561), ('futuristic', 4562), ('strike', 4563), ('sponge', 4564), ('batters', 4565), ('pitched', 4566), ('mice', 4567), ('discussion', 4568), ('vote', 4569), ('honk', 4570), ('thrown', 4571), ('rocking', 4572), ('float', 4573), ('branch', 4574), ('goers', 4575), ('leashes', 4576), ('tapestry', 4577), ('broom', 4578), ('naps', 4579), ('garnished', 4580), ('toothpicks', 4581), ('cigarettes', 4582), ('shelfs', 4583), ('curious', 4584), ('personnel', 4585), ('landed', 4586), ('species', 4587), ('unloaded', 4588), ('plains', 4589), ('attendant', 4590), ('colonial', 4591), ('attaching', 4592), ('lego', 4593), ('reached', 4594), ('ceremony', 4595), ('brides', 4596), ('jug', 4597), ('median', 4598), ('boars', 4599), ('hiking', 4600), ('dividing', 4601), ('winking', 4602), ('supply', 4603), ('believing', 4604), ('convention', 4605), ('casting', 4606), ('valley', 4607), ('brave', 4608), ('conditioner', 4609), ('tavern', 4610), ('chases', 4611), ('cubes', 4612), ('figurines', 4613), ('disrepair', 4614), ('threw', 4615), ('nurse', 4616), ('serves', 4617), ('dramatic', 4618), ('touched', 4619), ('pillar', 4620), ('raining', 4621), ('leaps', 4622), ('ropes', 4623), ('flavored', 4624), ('corgi', 4625), ('cable', 4626), ('toll', 4627), ('bows', 4628), ('geometric', 4629), ('engaging', 4630), ('contentedly', 4631), ('assisted', 4632), ('binder', 4633), ('cemetery', 4634), ('shocked', 4635), ('hips', 4636), ('raising', 4637), ('seeing', 4638), ('handmade', 4639), ('sunken', 4640), ('illusion', 4641), ('blooming', 4642), ('peep', 4643), ('boston', 4644), ('dust', 4645), ('t-shirts', 4646), ('napkins', 4647), ('spinning', 4648), ('cleared', 4649), ('peacock', 4650), ('smooth', 4651), ('hatchback', 4652), ('vinyl', 4653), ('took', 4654), ('arena', 4655), ('exercise', 4656), ('elder', 4657), ('coats', 4658), ('12', 4659), ('dad', 4660), ('grandfather', 4661), ('rom', 4662), ('hauling', 4663), ('toe', 4664), ('kleenex', 4665), ('muscular', 4666), ('fries', 4667), ('gym', 4668), ('want', 4669), ('guitar', 4670), ('drums', 4671), ('horn', 4672), ('neglected', 4673), ('coleslaw', 4674), ('facility', 4675), ('peeks', 4676), ('lie', 4677), ('instruments', 4678), ('felt', 4679), ('belly', 4680), ('birth', 4681), ('instrument', 4682), ('billboard', 4683), ('those', 4684), ('exactly', 4685), ('innocent', 4686), ('arch', 4687), ('pickle', 4688), ('flooding', 4689), ('south', 4690), ('flood', 4691), ('foaming', 4692), ('bring', 4693), ('antenna', 4694), ('browsing', 4695), ('crafting', 4696), ('foam', 4697), ('spotlight', 4698), ('filling', 4699), ('graduation', 4700), ('projection', 4701), ('stain', 4702), ('seasoning', 4703), ('cathedral', 4704), ('decals', 4705), ('performed', 4706), ('clydesdale', 4707), ('posh', 4708), ('ankle', 4709), ('nad', 4710), ('jam', 4711), ('york', 4712), ('department', 4713), ('toiled', 4714), ('crt', 4715), ('diners', 4716), ('possible', 4717), ('businessman', 4718), ('incredibly', 4719), ('yacht', 4720), ('sunbathing', 4721), ('wheelie', 4722), ('derelict', 4723), ('flanked', 4724), ('hotdog', 4725), ('yak', 4726), ('bulb', 4727), ('shoppers', 4728), ('flooded', 4729), ('swims', 4730), ('caution', 4731), ('liner', 4732), ('ridding', 4733), ('melted', 4734), ('yield', 4735), ('walkers', 4736), ('workspace', 4737), ('warmly', 4738), ('popping', 4739), ('blazer', 4740), ('awnings', 4741), ('grilled', 4742), ('eastern', 4743), ('scoops', 4744), ('super', 4745), ('battery', 4746), ('source', 4747), ('electricity', 4748), ('boxers', 4749), ('roses', 4750), ('eyeglasses', 4751), ('patches', 4752), ('rough', 4753), ('defensive', 4754), ('proudly', 4755), ('brahma', 4756), ('storm', 4757), ('pancake', 4758), ('stuffs', 4759), ('nearest', 4760), ('coach', 4761), ('wharf', 4762), ('coins', 4763), ('tee', 4764), ('nibbles', 4765), ('canadian', 4766), ('dinette', 4767), ('plethora', 4768), ('scissor', 4769), ('well-kept', 4770), ('adn', 4771), ('paste', 4772), ('sanctuary', 4773), ('shrine', 4774), ('virgin', 4775), ('mary', 4776), ('composite', 4777), ('ways', 4778), ('knick', 4779), ('airshow', 4780), ('goatee', 4781), ('11', 4782), ('hyde', 4783), ('jackson', 4784), ('bazaar', 4785), ('stately', 4786), ('escalator', 4787), ('pinned', 4788), ('clearly', 4789), ('finishes', 4790), ('forth', 4791), ('active', 4792), ('lay', 4793), ('zone', 4794), ('raincoats', 4795), ('mid-air', 4796), ('entire', 4797), ('triangular', 4798), ('sloping', 4799), ('napping', 4800), ('paraphernalia', 4801), ('reeds', 4802), ('montage', 4803), ('related', 4804), ('campsite', 4805), ('showroom', 4806), ('native', 4807), ('switch', 4808), ('terrible', 4809), ('biscuit', 4810), ('overturned', 4811), ('texts', 4812), ('ate', 4813), ('cuisine', 4814), ('dreads', 4815), ('song', 4816), ('participate', 4817), ('wipes', 4818), ('tend', 4819), ('calendar', 4820), ('share', 4821), ('earphones', 4822), ('bowler', 4823), ('fix', 4824), ('coco', 4825), ('cola', 4826), ('key', 4827), ('darkly', 4828), ('coca-cola', 4829), ('frizbee', 4830), ('lets', 4831), ('octagonal', 4832), ('fold', 4833), ('describing', 4834), ('jesus', 4835), ('confused', 4836), ('rub', 4837), ('shrubs', 4838), ('kicking', 4839), ('dimly-lit', 4840), ('coca', 4841), ('frisbe', 4842), ('christ', 4843), ('meant', 4844), ('coaches', 4845), ('wars', 4846), ('latest', 4847), ('gross', 4848), ('poop', 4849), ('flowing', 4850), ('balconies', 4851), ('scenes', 4852), ('chairlift', 4853), ('record', 4854), ('album', 4855), ('ot', 4856), ('swirls', 4857), ('ketchup', 4858), ('seashells', 4859), ('newer', 4860), ('participating', 4861), ('sheers', 4862), ('chevy', 4863), ('overflowing', 4864), ('bun', 4865), ('puppet', 4866), ('triple', 4867), ('instead', 4868), ('puppets', 4869), ('bowel', 4870), ('drainage', 4871), ('baron', 4872), ('grove', 4873), ('facet', 4874), ('attacking', 4875), ('peoples', 4876), ('alpine', 4877), ('carves', 4878), ('clothesline', 4879), ('ipod', 4880), ('scatter', 4881), ('barrel', 4882), ('treed', 4883), ('flask', 4884), ('west', 4885), ('barricades', 4886), ('react', 4887), ('push', 4888), ('fronts', 4889), ('blazing', 4890), ('pounce', 4891), ('strings', 4892), ('tun', 4893), ('upset', 4894), ('iphone', 4895), ('intently', 4896), ('grumpy', 4897), ('hutch', 4898), ('domestic', 4899), ('rushing', 4900), ('hipsters', 4901), ('gorilla', 4902), ('relish', 4903), ('daughters', 4904), ('bookbag', 4905), ('unripe', 4906), ('passanger', 4907), ('mp3', 4908), ('bass', 4909), ('sweet', 4910), ('candy', 4911), ('bunny', 4912), ('streaking', 4913), ('mitt', 4914), ('buiding', 4915), ('vegtables', 4916), ('particular', 4917), ('wrappers', 4918), ('caring', 4919), ('squares', 4920), ('regular', 4921), ('rims', 4922), ('cameraman', 4923), ('videos', 4924), ('scoreboard', 4925), ('flour', 4926), ('vanilla', 4927), ('removing', 4928), ('rushes', 4929), ('keeps', 4930), ('wired', 4931), ('handy', 4932), ('whats', 4933), ('pepsi', 4934), ('bordering', 4935), ('wrote', 4936), ('dozens', 4937), ('towering', 4938), ('outfielder', 4939), ('outstretched', 4940), ('waiter', 4941), ('finishing', 4942), ('apparel', 4943), ('intent', 4944), ('frisbees', 4945), ('palace', 4946), ('flashlight', 4947), ('smeared', 4948), ('analog', 4949), ('mesh', 4950), ('charging', 4951), ('placemats', 4952), ('topless', 4953), ('conversations', 4954), ('crazy', 4955), ('shaved', 4956), ('harness', 4957), ('pocket', 4958), ('twist', 4959), ('krispy', 4960), ('creme', 4961), ('ina', 4962), ('bulbs', 4963), ('caramel', 4964), ('aims', 4965), ('magnificent', 4966), ('hind', 4967), ('guests', 4968), ('juicer', 4969), ('k', 4970), ('dick', 4971), ('sure', 4972), ('else', 4973), ('markets', 4974), ('icy', 4975), ('grapefruits', 4976), ('folders', 4977), ('cords', 4978), ('activity', 4979), ('twists', 4980), ('grape', 4981), ('perfect', 4982), ('fighters', 4983), ('hardware', 4984), ('flatware', 4985), ('district', 4986), ('cosmetic', 4987), ('laces', 4988), ('via', 4989), ('movable', 4990), ('information', 4991), ('coordinating', 4992), ('businesses', 4993), ('idea', 4994), ('remains', 4995), ('olive', 4996), ('broad', 4997), ('flushing', 4998), ('forks', 4999), ('attracts', 5000), ('best', 5001), ('dives', 5002), ('del', 5003), ('elongated', 5004), ('perspective', 5005), ('region', 5006), ('spirit', 5007), ('mens', 5008), ('tangerines', 5009), ('grapefruit', 5010), ('soul', 5011), ('stillness', 5012), ('direct', 5013), ('pared', 5014), ('will', 5015), ('korean', 5016), ('product', 5017), ('excellent', 5018), ('social', 5019), ('drizzled', 5020), ('ties', 5021), ('cables', 5022), ('tagging', 5023), ('ostrich', 5024), ('rare', 5025), ('kits', 5026), ('pelican', 5027), ('smal', 5028), ('idle', 5029), ('writes', 5030), ('caged', 5031), ('flows', 5032), ('footpath', 5033), ('fridges', 5034), ('parasailers', 5035), ('choppy', 5036), ('sailors', 5037), ('commuting', 5038), ('rush', 5039), ('hour', 5040), ('heron', 5041), ('honda', 5042), ('gravy', 5043), ('outwards', 5044), ('dances', 5045), ('caddy', 5046), ('tshirt', 5047), ('able', 5048), ('always', 5049), ('effort', 5050), ('collared', 5051), ('rains', 5052), ('airline', 5053), ('pilots', 5054), ('protest', 5055), ('march', 5056), ('well-furnished', 5057), ('example', 5058), ('ok', 5059), ('multitude', 5060), ('cliffs', 5061), ('usually', 5062), ('bordered', 5063), ('ornamental', 5064), ('garment', 5065), ('customer', 5066), ('ham', 5067), ('negative', 5068), ('depiction', 5069), ('breast', 5070), ('poured', 5071), ('wineglass', 5072), ('pretends', 5073), ('?', 5074), ('concerned', 5075), ('pasted', 5076), ('spatulas', 5077), ('warning', 5078), ('lazy', 5079), ('susan', 5080), ('boulevard', 5081), ('warehouse', 5082), ('filtered', 5083), ('driven', 5084), ('bodyboard', 5085), ('ankles', 5086), ('tuxedo', 5087), ('disk', 5088), ('buidling', 5089), ('amidst', 5090), ('offering', 5091), ('intense', 5092), ('gazes', 5093), ('chats', 5094), ('concentrating', 5095), ('glider', 5096), ('curvy', 5097), ('tattooed', 5098), ('designer', 5099), ('winding', 5100), ('intricately', 5101), ('blades', 5102), ('inches', 5103), ('spring', 5104), ('holing', 5105), ('compete', 5106), ('wastebasket', 5107), ('dorm', 5108), ('motorhome', 5109), ('uniquely', 5110), ('firetruck', 5111), ('waist', 5112), ('upside-down', 5113), ('average', 5114), ('tiered', 5115), ('freezers', 5116), ('cock', 5117), ('click', 5118), ('lock', 5119), ('cliff', 5120), ('griddle', 5121), ('definitely', 5122), ('dear', 5123), ('wood-paneled', 5124), ('viewpoint', 5125), ('wander', 5126), ('dome', 5127), ('remove', 5128), ('dusty', 5129), ('replaced', 5130), ('rings', 5131), ('toast', 5132), ('hash', 5133), ('buried', 5134), ('sack', 5135), ('outlined', 5136), ('newest', 5137), ('vegetation', 5138), ('english', 5139), ('toyota', 5140), ('fog', 5141), ('withe', 5142), ('propping', 5143), ('chow', 5144), ('class', 5145), ('tipping', 5146), ('foggy', 5147), ('embrace', 5148), ('jack', 5149), ('handful', 5150), ('id', 5151), ('spewing', 5152), ('nozzle', 5153), ('pliers', 5154), ('sprays', 5155), ('breed', 5156), ('volunteers', 5157), ('amusement', 5158), ('poking', 5159), ('bowed', 5160), ('because', 5161), ('link', 5162), ('firefighters', 5163), ('instructions', 5164), ('spraying', 5165), ('splashing', 5166), ('outline', 5167), ('panes', 5168), ('carpeting', 5169), ('firefighter', 5170), ('bunched', 5171), ('birdcage', 5172), ('grasses', 5173), ('thought', 5174), ('firemen', 5175), ('confined', 5176), ('bathe', 5177), ('burgers', 5178), ('surroundings', 5179), ('disarray', 5180), ('crock', 5181), ('escape', 5182), ('jalapenos', 5183), ('comic', 5184), ('castle', 5185), ('gloved', 5186), ('squirting', 5187), ('jumble', 5188), ('stern', 5189), ('lei', 5190), ('celebrate', 5191), ('bruised', 5192), ('honey', 5193), ('ont', 5194), ('ban', 5195), ('rusting', 5196), ('hoagie', 5197), ('bullet', 5198), ('mohawk', 5199), ('pike', 5200), ('juggling', 5201), ('bust', 5202), ('yarn', 5203), ('ethnic', 5204), ('blind', 5205), ('wilderness', 5206), ('motorists', 5207), ('mount', 5208), ('page', 5209), ('describe', 5210), ('hosing', 5211), ('congregating', 5212), ('chipped', 5213), ('hops', 5214), ('stalk', 5215), ('cherry', 5216), ('blossom', 5217), ('closely', 5218), ('ith', 5219), ('flannel', 5220), ('rent', 5221), ('stereo', 5222), ('strolling', 5223), ('nature', 5224), ('finger', 5225), ('thumb', 5226), ('barely', 5227), ('pleasant', 5228), ('afternoon', 5229), ('straining', 5230), ('sin', 5231), ('blossoms', 5232), ('photographers', 5233), ('tasty', 5234), ('marathon', 5235), ('shark', 5236), ('upstairs', 5237), ('boulder', 5238), ('examined', 5239), ('later', 5240), ('jumped', 5241), ('stalks', 5242), ('largely', 5243), ('abundant', 5244), ('avoid', 5245), ('diverse', 5246), ('assembling', 5247), ('swan', 5248), ('stems', 5249), ('lilies', 5250), ('straws', 5251), ('saw', 5252), ('peers', 5253), ('chess', 5254), ('closes', 5255), ('sunflower', 5256), ('aligned', 5257), ('octopus', 5258), ('allot', 5259), ('harry', 5260), ('screens', 5261), ('casually', 5262), ('squid', 5263), ('stump', 5264), ('taller', 5265), ('sled', 5266), ('wax', 5267), ('shapes', 5268), ('paid', 5269), ('freeze', 5270), ('learns', 5271), ('celebrates', 5272), ('seal', 5273), ('kabob', 5274), ('appetizing', 5275), ('crammed', 5276), ('creams', 5277), ('available', 5278), ('beef', 5279), ('veggie', 5280), ('tier', 5281), ('buddhist', 5282), ('monks', 5283), ('racer', 5284), ('cargo', 5285), ('smoothies', 5286), ('sailor', 5287), ('apartments', 5288), ('nativity', 5289), ('roman', 5290), ('national', 5291), ('brightly-colored', 5292), ('loads', 5293), ('reclines', 5294), ('athletic', 5295), ('memorial', 5296), ('breaded', 5297), ('boar', 5298), ('jean', 5299), ('yoga', 5300), ('linens', 5301), ('went', 5302), ('sofas', 5303), ('croissant', 5304), ('shadowed', 5305), ('harley', 5306), ('davidson', 5307), ('recliner', 5308), ('dark-colored', 5309), ('plowed', 5310), ('solid', 5311), ('appetizer', 5312), ('eggplant', 5313), ('powdered', 5314), ('incline', 5315), ('atmosphere', 5316), ('seperated', 5317), ('bureau', 5318), ('anchored', 5319), ('greenery', 5320), ('disposal', 5321), ('diagonal', 5322), ('climate', 5323), ('disembark', 5324), ('clustered', 5325), ('trey', 5326), ('loves', 5327), ('scrub', 5328), ('collars', 5329), ('circus', 5330), ('bookstore', 5331), ('foldable', 5332), ('grates', 5333), ('sexy', 5334), ('gated', 5335), ('whizzes', 5336), ('snapshot', 5337), ('urn', 5338), ('shrub', 5339), ('facade', 5340), ('fired', 5341), ('packaged', 5342), ('save', 5343), ('blended', 5344), ('ofa', 5345), ('nightstand', 5346), ('syrup', 5347), ('saucers', 5348), ('totally', 5349), ('tons', 5350), ('varied', 5351), ('racquets', 5352), ('sniffs', 5353), ('uk', 5354), ('isolated', 5355), ('tows', 5356), ('pretend', 5357), ('rackets', 5358), ('boarded', 5359), ('executes', 5360), ('waterside', 5361), ('lantern', 5362), ('elvis', 5363), ('frown', 5364), ('pre', 5365), ('scary', 5366), ('beagle', 5367), ('sunrise', 5368), ('darker', 5369), ('benz', 5370), ('slowing', 5371), ('silhouetted', 5372), ('dead', 5373), ('sydney', 5374), ('australia', 5375), ('noodle', 5376), ('pint', 5377), ('balanced', 5378), ('horrible', 5379), ('tapes', 5380), ('energy', 5381), ('cushion', 5382), ('expressions', 5383), ('perpendicular', 5384), ('rimmed', 5385), ('fight', 5386), ('might', 5387), ('due', 5388), ('pops', 5389), ('exterior', 5390), ('height', 5391), ('peace', 5392), ('cropped', 5393), ('hear', 5394), ('pregnant', 5395), ('donkey', 5396), ('compared', 5397), ('deliver', 5398), ('struggling', 5399), ('shrimp', 5400), ('mushroom', 5401), ('dudes', 5402), ('skull', 5403), ('seasoned', 5404), ('momma', 5405), ('hoods', 5406), ('hauled', 5407), ('streetlights', 5408), ('entertaining', 5409), ('vast', 5410), ('20th', 5411), ('century', 5412), ('kiss', 5413), ('hooves', 5414), ('cubs', 5415), ('proceed', 5416), ('pushed', 5417), ('aside', 5418), ('rained', 5419), ('lace', 5420), ('meet', 5421), ('fender', 5422), ('ma', 5423), ('halter', 5424), ('stoplights', 5425), ('ceremonial', 5426), ('beaming', 5427), ('shawl', 5428), ('crackers', 5429), ('expressing', 5430), ('saucer', 5431), ('macbook', 5432), ('jumbo', 5433), ('observed', 5434), ('affectionate', 5435), ('function', 5436), ('valleys', 5437), ('tended', 5438), ('farmer', 5439), ('rising', 5440), ('blank', 5441), ('towns', 5442), ('damp', 5443), ('bovine', 5444), ('fo', 5445), ('pajamas', 5446), ('badge', 5447), ('servers', 5448), ('sending', 5449), ('logs', 5450), ('loaves', 5451), ('shattered', 5452), ('eight', 5453), ('congregate', 5454), ('cotton', 5455), ('occupy', 5456), ('ever', 5457), ('fluid', 5458), ('grills', 5459), ('braided', 5460), ('readies', 5461), ('consuming', 5462), ('grassland', 5463), ('leap', 5464), ('lilac', 5465), ('tortoiseshell', 5466), ('swirly', 5467), ('scrubby', 5468), ('hey', 5469), ('wraps', 5470), ('toes', 5471), ('fiddling', 5472), ('careful', 5473), ('classical', 5474), ('illuminating', 5475), ('appearance', 5476), ('bowtie', 5477), ('sound', 5478), ('checkout', 5479), ('park-like', 5480), ('jersey', 5481), ('earrings', 5482), ('balances', 5483), ('untied', 5484), ('cash', 5485), ('register', 5486), ('exchange', 5487), ('imac', 5488), ('purchase', 5489), ('drape', 5490), ('overgrown', 5491), ('slat', 5492), ('unpaved', 5493), ('harnessed', 5494), ('glazed', 5495), ('sculptures', 5496), ('lip', 5497), ('ordering', 5498), ('backhand', 5499), ('exchanging', 5500), ('admiring', 5501), ('certain', 5502), ('signing', 5503), ('graffitied', 5504), ('pilot', 5505), ('moved', 5506), ('sittin', 5507), ('sock', 5508), ('moment', 5509), ('font', 5510), ('avocado', 5511), ('mets', 5512), ('trapped', 5513), ('opposing', 5514), ('glue', 5515), ('steamed', 5516), ('assists', 5517), ('patient', 5518), ('shelter', 5519), ('england', 5520), ('poll', 5521), ('deco', 5522), ('tearing', 5523), ('brownish', 5524), ('detour', 5525), ('25', 5526), ('carrot', 5527), ('description', 5528), ('scratched', 5529), ('strong', 5530), ('obscene', 5531), ('said', 5532), ('thinks', 5533), ('casts', 5534), ('advertises', 5535), ('nine', 5536), ('sat', 5537), ('entertainment', 5538), ('rental', 5539), ('ascending', 5540), ('docking', 5541), ('trucked', 5542), ('pears', 5543), ('flatscreen', 5544), ('leisurely', 5545), ('strolls', 5546), ('overcast', 5547), ('keychain', 5548), ('differently', 5549), ('graveyard', 5550), ('express', 5551), ('twilight', 5552), ('airways', 5553), ('menacingly', 5554), ('grave', 5555), ('priest', 5556), ('biplane', 5557), ('lifts', 5558), ('tech', 5559), ('titled', 5560), ('armoire', 5561), ('motorcyles', 5562), ('dirtbike', 5563), ('motocross', 5564), ('member', 5565), ('graveled', 5566), ('overalls', 5567), ('sidecar', 5568), ('whipped', 5569), ('spanish', 5570), ('unknown', 5571), ('location', 5572), ('steeple', 5573), ('bi', 5574), ('releasing', 5575), ('taxidermy', 5576), ('graze', 5577), ('diagonally', 5578), ('streams', 5579), ('vicinity', 5580), ('vessels', 5581), ('dispensing', 5582), ('taxiing', 5583), ('upholstered', 5584), ('acrobatic', 5585), ('dusting', 5586), ('kreme', 5587), ('obstacles', 5588), ('keeping', 5589), ('grounded', 5590), ('guiding', 5591), ('curves', 5592), ('camouflaged', 5593), ('lick', 5594), ('crashed', 5595), ('yamaha', 5596), ('architecture', 5597), ('religious', 5598), ('serviced', 5599), ('escort', 5600), ('mule', 5601), ('freight', 5602), ('pines', 5603), ('catholic', 5604), ('release', 5605), ('presented', 5606), ('rectangle', 5607), ('airstrip', 5608), ('dine', 5609), ('controls', 5610), ('pallet', 5611), ('soar', 5612), ('paused', 5613), ('euro', 5614), ('sculpted', 5615), ('inclosure', 5616), ('trails', 5617), ('propellers', 5618), ('squadron', 5619), ('parcel', 5620), ('southwest', 5621), ('idyllic', 5622), ('vineyard', 5623), ('explaining', 5624), ('ii', 5625), ('receives', 5626), ('web', 5627), ('pages', 5628), ('stormy', 5629), ('fleet', 5630), ('squeezing', 5631), ('crops', 5632), ('canada', 5633), ('dip', 5634), ('response', 5635), ('screened', 5636), ('lunchbox', 5637), ('tourists', 5638), ('barbie', 5639), ('fierce', 5640), ('wanting', 5641), ('parsley', 5642), ('memorabilia', 5643), ('jungle', 5644), ('tailed', 5645), ('spilling', 5646), ('cubical', 5647), ('pat', 5648), ('nd', 5649), ('flap', 5650), ('rounds', 5651), ('welcome', 5652), ('rally', 5653), ('transported', 5654), ('dinnerware', 5655), ('rapidly', 5656), ('skeleton', 5657), ('saluting', 5658), ('perform', 5659), ('pyramid', 5660), ('auditorium', 5661), ('congratulations', 5662), ('airfield', 5663), ('tinsel', 5664), ('jetliners', 5665), ('bulding', 5666), ('spelled', 5667), ('crumbs', 5668), ('navel', 5669), ('crop', 5670), ('remnants', 5671), ('weathervane', 5672), ('charter', 5673), ('lands', 5674), ('procession', 5675), ('doggie', 5676), ('batches', 5677), ('iced', 5678), ('chipping', 5679), ('clocktower', 5680), ('nesting', 5681), ('landscaping', 5682), ('weathered', 5683), ('st.', 5684), ('broadway', 5685), ('bomber', 5686), ('rocket', 5687), ('astride', 5688), ('printer', 5689), ('customized', 5690), ('eiffel', 5691), ('mingling', 5692), ('snap', 5693), ('urine', 5694), ('captivity', 5695), ('current', 5696), ('gay', 5697), ('pride', 5698), ('moon', 5699), ('gently', 5700), ('barrels', 5701), ('glory', 5702), ('final', 5703), ('branches', 5704), ('habitat', 5705), ('cant', 5706), ('66', 5707), ('pylons', 5708), ('guitars', 5709), ('sidewalks', 5710), ('qantas', 5711), ('cloudless', 5712), ('charcoal', 5713), ('vans', 5714), ('root', 5715), ('retriever', 5716), ('wandering', 5717), ('triumph', 5718), ('seaplane', 5719), ('standstill', 5720), ('gallery', 5721), ('onlooking', 5722), ('savanna', 5723), ('adolescent', 5724), ('ascends', 5725), ('ibm', 5726), ('tar', 5727), ('dalmatian', 5728), ('obstructed', 5729), ('delicous', 5730), ('woody', 5731), ('gnome', 5732), ('billboards', 5733), ('cactus', 5734), ('necks', 5735), ('resembling', 5736), ('tear', 5737), ('reason', 5738), ('vertically', 5739), ('jetway', 5740), ('propellor', 5741), ('shrubbery', 5742), ('capital', 5743), ('international', 5744), ('cranes', 5745), ('transports', 5746), ('admire', 5747), ('serious', 5748), ('restored', 5749), ('aeroplane', 5750), ('hover', 5751), ('investigating', 5752), ('scrap', 5753), ('musicians', 5754), ('simultaneously', 5755), ('limb', 5756), ('tuck', 5757), ('medal', 5758), ('combines', 5759), ('unopened', 5760), ('historical', 5761), ('arial', 5762), ('soars', 5763), ('streaks', 5764), ('until', 5765), ('authentic', 5766), ('spire', 5767), ('airliners', 5768), ('sneaks', 5769), ('troop', 5770), ('license', 5771), ('hobby', 5772), ('hawaiian', 5773), ('winged', 5774), ('panties', 5775), ('triangle', 5776), ('cracker', 5777), ('wedges', 5778), ('fueling', 5779), ('hummus', 5780), ('cilantro', 5781), ('specialty', 5782), ('b', 5783), ('bi-plane', 5784), ('taxing', 5785), ('salt', 5786), ('clementines', 5787), ('controlling', 5788), ('stemmed', 5789), ('afro', 5790), ('unidentified', 5791), ('portions', 5792), ('gestures', 5793), ('crotch', 5794), ('caked', 5795), ('travelers', 5796), ('descends', 5797), ('picks', 5798), ('vests', 5799), ('vivid', 5800), ('salesman', 5801), ('charm', 5802), ('54', 5803), ('die', 5804), ('services', 5805), ('utilizing', 5806), ('stair', 5807), ('arrived', 5808), ('oatmeal', 5809), ('kawasaki', 5810), ('artful', 5811), ('escorting', 5812), ('plugging', 5813), ('motorcyle', 5814), ('hd', 5815), ('earlier', 5816), ('inner', 5817), ('prop', 5818), ('motorcylce', 5819), ('linger', 5820), ('sidelines', 5821), ('floaters', 5822), ('uncooked', 5823), ('unpainted', 5824), ('diffrent', 5825), ('stray', 5826), ('sprayed', 5827), ('helicopter', 5828), ('fancily', 5829), ('fabrics', 5830), ('cabbage', 5831), ('evil', 5832), ('chopper', 5833), ('gothic', 5834), ('skyscraper', 5835), ('jail', 5836), ('engines', 5837), ('scarves', 5838), ('stylized', 5839), ('accessory', 5840), ('passageway', 5841), ('afar', 5842), ('squat', 5843), ('streamlined', 5844), ('imposed', 5845), ('yankee', 5846), ('co', 5847), ('bikinis', 5848), ('angels', 5849), ('handler', 5850), ('mandarin', 5851), ('dhl', 5852), ('keeper', 5853), ('horned', 5854), ('pitching', 5855), ('biplanes', 5856), ('zookeeper', 5857), ('den', 5858), ('maybe', 5859), ('boeing', 5860), ('bleak', 5861), ('dried', 5862), ('cave', 5863), ('pub', 5864), ('contrails', 5865), ('notice', 5866), ('artificial', 5867), ('dropping', 5868), ('named', 5869), ('shaded', 5870), ('kingfisher', 5871), ('usa', 5872), ('temple', 5873), ('brussel', 5874), ('sprouts', 5875), ('sporty', 5876), ('goats', 5877), ('steak', 5878), ('mascot', 5879), ('faint', 5880), ('files', 5881), ('winning', 5882), ('marks', 5883), ('strikes', 5884), ('fell', 5885), ('yogurt', 5886), ('granola', 5887), ('terminals', 5888), ('pews', 5889), ('outskirts', 5890), ('descent', 5891), ('france', 5892), ('duty', 5893), ('approached', 5894), ('drag', 5895), ('mulch', 5896), ('collected', 5897), ('paired', 5898), ('sleeveless', 5899), ('carnival', 5900), ('widescreen', 5901), ('markings', 5902), ('buldings', 5903), ('merge', 5904), ('wrinkled', 5905), ('matt', 5906), ('dolphin', 5907), ('screwed', 5908), ('fedex', 5909), ('firm', 5910), ('looms', 5911), ('tripod', 5912), ('loved', 5913), ('cantaloupe', 5914), ('baseballs', 5915), ('chocolates', 5916), ('crashes', 5917), ('queue', 5918), ('tangerine', 5919), ('attachments', 5920), ('mauve', 5921), ('timey', 5922), ('calf', 5923), ('choose', 5924), ('beast', 5925), ('shredding', 5926), ('alert', 5927), ('zones', 5928), ('leaking', 5929), ('swamp', 5930), ('selecting', 5931), ('origami', 5932), ('servicing', 5933), ('cartoons', 5934), ('klm', 5935), (\"o'clock\", 5936), ('knob', 5937), ('perked', 5938), ('ana', 5939), ('keyboards', 5940), ('slippers', 5941), ('pleased', 5942), ('departure', 5943), ('ex', 5944), ('protect', 5945), ('ox', 5946), ('title', 5947), ('needle', 5948), ('calling', 5949), ('lufthansa', 5950), ('y', 5951), ('stretch', 5952), ('transformed', 5953), ('barefooted', 5954), ('gears', 5955), ('broth', 5956), ('strap', 5957), ('skinned', 5958), ('announcer', 5959), ('spikes', 5960), ('called', 5961), ('upwards', 5962), ('dunes', 5963), ('interstate', 5964), ('table..', 5965), ('doggy', 5966), ('stitched', 5967), ('lowers', 5968), ('broke', 5969), ('lambs', 5970), ('centerpiece', 5971), ('meadow', 5972), ('exotic', 5973), ('pens', 5974), ('crane', 5975), ('try', 5976), ('runways', 5977), ('tanker', 5978), ('raspberries', 5979), ('juicy', 5980), ('alter', 5981), ('review', 5982), ('eleven', 5983), ('clouded', 5984), ('drenched', 5985), ('fences', 5986), ('projected', 5987), ('satellite', 5988), ('#', 5989), ('airfrance', 5990), ('22', 5991), ('renaissance', 5992), ('countries', 5993), ('dental', 5994), ('linked', 5995), ('struts', 5996), ('stockings', 5997), ('doctors', 5998), ('bomb', 5999), ('purses', 6000), ('emptied', 6001), ('showcase', 6002), ('clusters', 6003), ('rooftop', 6004), ('pup', 6005), ('doctor', 6006), ('licks', 6007), ('bounces', 6008), ('creative', 6009), ('levels', 6010), ('twenty', 6011), ('take-off', 6012), ('scruffy', 6013), ('speedboat', 6014), ('send', 6015), ('minnesota', 6016), ('dragging', 6017), ('nibbling', 6018), ('suckling', 6019), ('donation', 6020), ('thorough', 6021), ('cherries', 6022), ('bushel', 6023), ('alaska', 6024), ('oversized', 6025), ('dentist', 6026), ('plans', 6027), ('examining', 6028), ('24', 6029), ('informing', 6030), ('trial', 6031), ('county', 6032), ('scoop', 6033), ('starts', 6034), ('smartphones', 6035), ('grasps', 6036), ('workbench', 6037), ('pacifier', 6038), ('whale', 6039), ('ostriches', 6040), ('feasting', 6041), ('stilts', 6042), ('dividers', 6043), ('lion', 6044), ('navy', 6045), ('models', 6046), ('flamingo', 6047), ('heart', 6048), ('former', 6049), ('usage', 6050), ('resemble', 6051), ('journey', 6052), ('melons', 6053), ('controllers', 6054), ('combat', 6055), ('halves', 6056), ('chat', 6057), ('missed', 6058), ('bbq', 6059), ('channel', 6060), ('mementos', 6061), ('peaches', 6062), ('problem', 6063), ('bears', 6064), ('cinder', 6065), ('lookout', 6066), ('noon', 6067), ('pointy', 6068), ('ditch', 6069), ('varying', 6070), ('balloon', 6071), ('ease', 6072), ('truly', 6073), ('awful', 6074), ('mexico', 6075), ('runaway', 6076), ('turf', 6077), ('boiled', 6078), ('captive', 6079), ('batting', 6080), ('u-turn', 6081), ('bend', 6082), ('sliver', 6083), ('vancouver', 6084), ('monkeys', 6085), ('curving', 6086), ('positions', 6087), ('canister', 6088), ('emblem', 6089), ('hilly', 6090), ('televisions', 6091), ('intersections', 6092), ('carved', 6093), ('browning', 6094), ('mortar', 6095), ('russian', 6096), ('bells', 6097), ('deployed', 6098), ('racetrack', 6099), ('dressers', 6100), ('decked', 6101), ('leftover', 6102), ('becoming', 6103), ('musical', 6104), ('patchy', 6105), ('bib', 6106), ('duct', 6107), ('atv', 6108), ('printing', 6109), ('butt', 6110), ('joint', 6111), ('media', 6112), ('aircrafts', 6113), ('flat-screen', 6114), ('spitting', 6115), ('peaceful', 6116), ('pin', 6117), ('bunk', 6118), ('allowing', 6119), ('tangled', 6120), ('smoggy', 6121), ('dollar', 6122), ('bill', 6123), ('accordion', 6124), ('gauges', 6125), ('fulled', 6126), ('ally', 6127), ('dawn', 6128), ('dvd', 6129), ('kiwis', 6130), ('unison', 6131), ('accept', 6132), ('clapping', 6133), ('silos', 6134), ('sheeps', 6135), ('redheaded', 6136), ('te', 6137), ('pavers', 6138), ('mama', 6139), ('llama', 6140), ('cheering', 6141), ('important', 6142), ('movies', 6143), ('feeder', 6144), ('parakeet', 6145), ('completed', 6146), ('themes', 6147), ('skyteam', 6148), ('roped', 6149), ('sony', 6150), ('casing', 6151), ('mid-flight', 6152), ('plaque', 6153), ('weaving', 6154), ('penny', 6155), ('fireworks', 6156), ('miss', 6157), ('towers', 6158), ('foundation', 6159), ('leak', 6160), ('tim', 6161), ('grinning', 6162), ('wreck', 6163), ('lazing', 6164), ('erect', 6165), ('captures', 6166), ('desolate', 6167), ('gliders', 6168), ('supermarket', 6169), ('proceeding', 6170), ('exhibition', 6171), ('rounding', 6172), ('digging', 6173), ('obese', 6174), ('disposable', 6175), ('gleaming', 6176), ('calculator', 6177), ('holidays', 6178), ('domed', 6179), ('mingle', 6180), ('u', 6181), ('fling', 6182), ('banister', 6183), ('wonderful', 6184), ('decaying', 6185), ('observation', 6186), ('booths', 6187), ('thumbs-up', 6188), ('squad', 6189), ('refueling', 6190), ('roaring', 6191), ('pant', 6192), ('lowering', 6193), ('turkeys', 6194), ('guacamole', 6195), ('shipping', 6196), ('farmers', 6197), ('hoisted', 6198), ('disassembled', 6199), ('access', 6200), ('pontoon', 6201), ('sideline', 6202), ('icon', 6203), ('emirates', 6204), ('examine', 6205), ('bison', 6206), ('peek', 6207), ('trots', 6208), ('consist', 6209), ('intertwined', 6210), ('marijuana', 6211), ('shadows', 6212), ('half-eaten', 6213), ('visiting', 6214), ('sectioned', 6215), ('squinting', 6216), ('tigers', 6217), ('dig', 6218), ('user', 6219), ('minor', 6220), ('muffin', 6221), ('wrapper', 6222), ('sprawled', 6223), ('beached', 6224), ('cd', 6225), ('cds', 6226), ('envelope', 6227), ('mantle', 6228), ('brief', 6229), ('article', 6230), ('wallet', 6231), ('cheap', 6232), ('dull', 6233), ('whether', 6234), ('indicator', 6235), ('woolly', 6236), ('overhang', 6237), ('collision', 6238), ('sas', 6239), ('gaining', 6240), ('motionless', 6241), ('appropriate', 6242), ('rubble', 6243), ('plat', 6244), ('styles', 6245), ('dc', 6246), ('calves', 6247), ('witting', 6248), ('projector', 6249), ('controlled', 6250), ('20', 6251), ('nasa', 6252), ('thai', 6253), ('become', 6254), ('dumped', 6255), ('reddish', 6256), ('hued', 6257), ('folder', 6258), ('adobe', 6259), ('mango', 6260), ('decided', 6261), ('wool', 6262), ('noses', 6263), ('sell', 6264), ('rugged', 6265), ('producing', 6266), ('trailers', 6267), ('freely', 6268), ('bales', 6269), ('conducting', 6270), ('sheered', 6271), ('comparing', 6272), ('fro', 6273), ('terrain', 6274), ('horse-drawn', 6275), ('bails', 6276), ('choir', 6277), ('sheared', 6278), ('whom', 6279), ('chopsticks', 6280), ('dance', 6281), ('attendants', 6282), ('cruising', 6283), ('adjust', 6284), ('largest', 6285), ('hate', 6286), ('fencing', 6287), ('proximity', 6288), ('reflections', 6289), ('restrooms', 6290), ('gadget', 6291), ('frontier', 6292), ('girafee', 6293), ('wildlife', 6294), ('plank', 6295), ('attending', 6296), ('jeeps', 6297), ('discarded', 6298), ('numerals', 6299), ('saint', 6300), ('amounts', 6301), ('obelisk', 6302), ('salads', 6303), ('bronze', 6304), ('streetcar', 6305), ('ran', 6306), ('twisted', 6307), ('compute', 6308), ('r', 6309), ('trolly', 6310), ('cobblestones', 6311), ('defense', 6312), ('twisting', 6313), ('ram', 6314), ('heart-shaped', 6315), ('dreary', 6316), ('13', 6317), ('bringing', 6318), ('gap', 6319), ('rover', 6320), ('manmade', 6321), ('death', 6322), ('signpost', 6323), ('forming', 6324), ('dalmation', 6325), ('edged', 6326), ('follow', 6327), ('visor', 6328), ('fox', 6329), ('loader', 6330), ('barricade', 6331), ('tether', 6332), ('kneel', 6333), ('alot', 6334), ('pickles', 6335), ('granny', 6336), ('pallets', 6337), ('chain-link', 6338), ('pork', 6339), ('mound', 6340), ('recreation', 6341), ('readied', 6342), ('postcard', 6343), ('involving', 6344), ('glide', 6345), ('courthouse', 6346), ('duffle', 6347), ('fours', 6348), ('political', 6349), ('scones', 6350), ('breath', 6351), ('german', 6352), ('shepard', 6353), ('duffel', 6354), ('blueberries', 6355), ('quarters', 6356), ('canned', 6357), ('juvenile', 6358), ('starring', 6359), ('fudge', 6360), ('zebras', 6361), ('fin', 6362), ('wallets', 6363), ('skidding', 6364), ('sip', 6365), ('slug', 6366), ('modeling', 6367), ('insect', 6368), ('tip', 6369), ('respected', 6370), ('swimsuit', 6371), ('binders', 6372), ('flaps', 6373), ('stock', 6374), ('ting', 6375), ('closets', 6376), ('hammer', 6377), ('parachuting', 6378), ('contemplating', 6379), ('tacks', 6380), ('sum', 6381), ('trade', 6382), ('teacup', 6383), ('gazebo', 6384), ('emitting', 6385), ('badges', 6386), ('clipped', 6387), ('government', 6388), ('scrubs', 6389), ('releases', 6390), ('clump', 6391), ('cabbages', 6392), ('ther', 6393), ('gifts', 6394), ('monorail', 6395), ('obstacle', 6396), ('flickr', 6397), ('spires', 6398), ('properly', 6399), ('rooster', 6400), ('compass', 6401), ('skillfully', 6402), ('street..', 6403), ('mounds', 6404), ('bundles', 6405), ('heard', 6406), ('fliers', 6407), ('747', 6408), ('footprints', 6409), ('captain', 6410), ('expansive', 6411), ('bridges', 6412), ('ferries', 6413), ('steady', 6414), ('outer', 6415), ('mangoes', 6416), ('figs', 6417), ('la', 6418), ('charity', 6419), ('volunteer', 6420), ('hope', 6421), ('cushioned', 6422), ('presidential', 6423), ('mad', 6424), ('george', 6425), ('exits', 6426), ('nearing', 6427), ('grin', 6428), ('dam', 6429), ('notepad', 6430), ('lieing', 6431), ('watering', 6432), ('manger', 6433), ('googly', 6434), ('britain', 6435), ('headphone', 6436), ('lions', 6437), ('dachshund', 6438), ('collect', 6439), ('tree-lined', 6440), ('startled', 6441), ('erected', 6442), ('longer', 6443), ('waterfront', 6444), ('lifeguard', 6445), ('pound', 6446), ('sniff', 6447), ('heritage', 6448), ('gloomy', 6449), ('denim', 6450), ('dangerously', 6451), ('search', 6452), ('strategically', 6453), ('segments', 6454), ('shortcake', 6455), ('artifacts', 6456), ('parchment', 6457), ('parallel', 6458), ('ford', 6459), ('snake', 6460), ('foyer', 6461), ('pavilion', 6462), ('tofu', 6463), ('decides', 6464), ('medley', 6465), ('heaped', 6466), ('humorous', 6467), ('intended', 6468), ('sheeted', 6469), ('fondant', 6470), ('wooly', 6471), ('feta', 6472), ('wrong', 6473), ('one-way', 6474), ('heap', 6475), ('officials', 6476), ('yummy', 6477), ('peeping', 6478), ('caterpillar', 6479), ('guides', 6480), ('bard', 6481), ('leafs', 6482), ('grasslands', 6483), ('planters', 6484), ('automated', 6485), ('v', 6486), ('handwritten', 6487), ('awkwardly', 6488), ('childrens', 6489), ('lampposts', 6490), ('lollipops', 6491), ('cutlery', 6492), ('attend', 6493), ('pebbles', 6494), ('crabs', 6495), ('eva', 6496), ('hello', 6497), ('sword', 6498), ('plantains', 6499), ('shallows', 6500), ('overripe', 6501), ('manufacturing', 6502), ('dumping', 6503), ('coke', 6504), ('protesters', 6505), ('tangle', 6506), ('knee', 6507), ('capable', 6508), ('gone', 6509), ('mailbox', 6510), ('7', 6511), ('blinders', 6512), ('pear', 6513), ('sking', 6514), ('antelope', 6515), ('enclosures', 6516), ('options', 6517), ('ruler', 6518), ('belonging', 6519), ('parading', 6520), ('billows', 6521), ('adventure', 6522), ('coaster', 6523), ('banks', 6524), ('tastes', 6525), ('liberty', 6526), ('circles', 6527), ('runner', 6528), ('launch', 6529), ('coating', 6530), ('shakers', 6531), ('[', 6532), ('necklace', 6533), ('contest', 6534), ('price', 6535), ('mechanical', 6536), ('headboard', 6537), ('bones', 6538), ('plume', 6539), ('director', 6540), ('typewriter', 6541), ('rams', 6542), ('bitten', 6543), ('$', 6544), ('icecream', 6545), ('microsoft', 6546), ('performer', 6547), ('webpage', 6548), ('teenaged', 6549), ('competitor', 6550), ('assist', 6551), ('safari', 6552), ('creamy', 6553), ('peas', 6554), ('catering', 6555), ('tilting', 6556), ('socialize', 6557), ('dune', 6558), ('pig', 6559), ('bodies', 6560), ('scottish', 6561), ('flyer', 6562), ('fettuccine', 6563), ('sanitizer', 6564), ('kicks', 6565), ('mix', 6566), ('swift', 6567), ('wildflowers', 6568), ('daisies', 6569), ('fern', 6570), ('steeples', 6571), ('telephones', 6572), ('executive', 6573), ('eagerly', 6574), ('orchard', 6575), ('searching', 6576), ('inscribed', 6577), ('nobody', 6578), ('edited', 6579), ('arbor', 6580), ('runners', 6581), ('forty', 6582), ('sales', 6583), ('misty', 6584), ('dodge', 6585), ('fascinated', 6586), ('north', 6587), ('baord', 6588), ('receive', 6589), ('pamphlets', 6590), ('piping', 6591), ('finds', 6592), ('east', 6593), ('tvs', 6594), ('moored', 6595), ('pea', 6596), ('8', 6597), ('detail', 6598), ('gps', 6599), ('smiley', 6600), ('sidecars', 6601), ('brochures', 6602), ('funnel', 6603), ('chip', 6604), ('farther', 6605), ('theres', 6606), ('tress', 6607), ('rabbits', 6608), ('thousands', 6609), ('monk', 6610), ('happen', 6611), ('girraffe', 6612), ('mcdonald', 6613), ('crews', 6614), ('seaside', 6615), ('san', 6616), ('francisco', 6617), ('drilling', 6618), ('rig', 6619), ('weapon', 6620), ('basil', 6621), ('pacific', 6622), ('mcdonalds', 6623), ('advertised', 6624), ('louis', 6625), ('bleacher', 6626), ('coated', 6627), ('folks', 6628), ('hearts', 6629), ('nutella', 6630), ('avocados', 6631), ('shortly', 6632), ('hes', 6633), ('barns', 6634), ('gaming', 6635), ('consoles', 6636), ('malaysia', 6637), ('ave', 6638), ('systems', 6639), ('closest', 6640), ('undone', 6641), ('beaten', 6642), ('cheesecake', 6643), ('garnishment', 6644), ('creatively', 6645), ('furthest', 6646), ('slatted', 6647), ('unripened', 6648), ('regal', 6649), ('diagram', 6650), ('roofed', 6651), ('os', 6652), ('exposure', 6653), ('pads', 6654), ('orchid', 6655), ('numeral', 6656), ('instructional', 6657), ('vehicular', 6658), ('boulders', 6659), ('margarita', 6660), ('farmland', 6661), ('gatorade', 6662), ('chunk', 6663), ('luggages', 6664), ('forces', 6665), ('skirts', 6666), ('carraige', 6667), ('wheat', 6668), ('sleigh', 6669), ('humongous', 6670), ('thatch', 6671), ('comics', 6672), ('pastures', 6673), ('medals', 6674), ('overloaded', 6675), ('turbine', 6676), ('barbed', 6677), ('monstrosity', 6678), ('conveyor', 6679), ('citizens', 6680), ('barbwire', 6681), ('popular', 6682), ('brim', 6683), ('mamma', 6684), ('dented', 6685), ('buns', 6686), ('coffe', 6687), ('inflated', 6688), ('stnading', 6689), ('installing', 6690), ('mash', 6691), ('reader', 6692), ('dinosaurs', 6693), ('ranch', 6694), ('poem', 6695), ('graphics', 6696), ('ladders', 6697), ('films', 6698), ('huddling', 6699), ('etched', 6700), ('rods', 6701), ('purpose', 6702), ('enclose', 6703), ('actually', 6704), ('target', 6705), ('preserve', 6706), ('packs', 6707), ('bespectacled', 6708), ('pomegranate', 6709), ('nowhere', 6710), ('leroy', 6711), ('canyon', 6712), ('impressive', 6713), ('atlantic', 6714), ('toga', 6715), ('inthe', 6716), ('turtle', 6717), ('unload', 6718), ('browses', 6719), ('offer', 6720), ('stones', 6721), ('listen', 6722), ('socializing', 6723), ('pancakes', 6724), ('savannah', 6725), ('nourishment', 6726), ('slats', 6727), ('remarkable', 6728), ('pins', 6729), ('parlor', 6730), ('downwards', 6731), ('berry', 6732), ('watered', 6733), ('masked', 6734), ('extraordinary', 6735), ('takeout', 6736), ('duvet', 6737), ('lava', 6738), ('stunning', 6739), ('pitch', 6740), ('blackberries', 6741), ('picked', 6742), ('m', 6743), ('blackberry', 6744), ('ray', 6745), ('poked', 6746), ('geared', 6747), ('bible', 6748), ('shepherd', 6749), ('confusing', 6750), ('pm', 6751), ('40', 6752), ('marine', 6753), ('trellis', 6754), ('scraps', 6755), ('australian', 6756), ('laden', 6757), ('firetrucks', 6758), ('attack', 6759), ('robotic', 6760), ('gutter', 6761), ('tater', 6762), ('dangerous', 6763), ('reindeer', 6764), ('camel', 6765), ('centre', 6766), ('greet', 6767), ('true', 6768), ('scream', 6769), ('allow', 6770), ('menus', 6771), ('minute', 6772), ('inspected', 6773), ('four-wheeler', 6774), ('patrick', 6775), ('stars', 6776), ('atvs', 6777), ('easter', 6778), ('escorted', 6779), ('brothers', 6780), ('maneuvers', 6781), ('locations', 6782), ('anchor', 6783), ('comical', 6784), ('observes', 6785), ('irish', 6786), ('duplicate', 6787), ('languages', 6788), ('burger', 6789), ('king', 6790), ('capitol', 6791), ('ona', 6792), ('accepting', 6793), ('mist', 6794), ('swirling', 6795), ('greek', 6796), ('presidents', 6797), ('burned', 6798), ('carriers', 6799), ('packets', 6800), ('sandwiched', 6801), ('season', 6802), ('ferns', 6803), ('equestrian', 6804), ('rivers', 6805), ('casino', 6806), ('inverted', 6807), ('tuna', 6808), ('garnishes', 6809), ('scantily', 6810), ('wiped', 6811), ('trophy', 6812), ('relatively', 6813), ('it..', 6814), ('nintendo', 6815), ('mouses', 6816), ('puff', 6817), ('vcr', 6818), ('build', 6819), ('wildebeest', 6820), ('cellar', 6821), ('egyptian', 6822), ('middle-aged', 6823), ('unkempt', 6824), ('guide', 6825), ('protects', 6826), ('grow', 6827), ('flattened', 6828), ('recycling', 6829), ('trainer', 6830), ('pineapple', 6831), ('peopel', 6832), ('varieties', 6833), ('bushels', 6834), ('streamers', 6835), ('civil', 6836), ('sneaker', 6837), ('blown', 6838), ('oozing', 6839), ('guns', 6840), ('complicated', 6841), ('corners', 6842), ('emerges', 6843), ('barriers', 6844), ('dangled', 6845), ('discs', 6846), ('bridle', 6847), ('ads', 6848), ('contrail', 6849), ('quilted', 6850), ('rat', 6851), ('league', 6852), ('softball', 6853), ('tiki', 6854), ('symbols', 6855), ('jeff', 6856), ('lightening', 6857), ('billowing', 6858), ('traveled', 6859), ('melting', 6860), ('quick', 6861), ('characters', 6862), ('destination', 6863), ('similarly', 6864), ('wispy', 6865), ('shares', 6866), ('musician', 6867), ('lecture', 6868), ('claws', 6869), ('irises', 6870), ('brought', 6871), ('stroll', 6872), ('days', 6873), ('cities', 6874), ('lapse', 6875), ('roofs', 6876), ('prairie', 6877), ('comically', 6878), ('hangers', 6879), ('sunk', 6880), ('especially', 6881), ('crib', 6882), ('offered', 6883), ('clumps', 6884), ('soil', 6885), ('ambulances', 6886), ('squatted', 6887), ('two-tiered', 6888), ('notebooks', 6889), ('35', 6890), ('presses', 6891), ('advantage', 6892), ('briefcase', 6893), ('mossy', 6894), ('lizard', 6895), ('causing', 6896), ('statute', 6897), ('caboose', 6898), ('batteries', 6899), ('valves', 6900), ('choice', 6901), ('popcorn', 6902), ('brocolli', 6903), ('horizontally', 6904), ('peope', 6905), ('snowstorm', 6906), ('funeral', 6907), ('plot', 6908), ('attraction', 6909), ('ump', 6910), ('tested', 6911), ('transparent', 6912), ('tummy', 6913), ('merchant', 6914), ('pawing', 6915), ('chunks', 6916), ('novelty', 6917), ('battle', 6918), ('wrapping', 6919), ('cemetary', 6920), ('separates', 6921), ('network', 6922), ('perhaps', 6923), ('attentive', 6924), ('document', 6925), ('venice', 6926), ('italy', 6927), ('pinkish', 6928), ('detailing', 6929), ('alligator', 6930), ('yawning', 6931), ('dancer', 6932), ('sausage', 6933), ('teh', 6934), ('hippo', 6935), ('somber', 6936), ('sipping', 6937), ('suspension', 6938), ('dipped', 6939), ('beret', 6940), ('grits', 6941), ('least', 6942), ('wanders', 6943), ('burritos', 6944), ('pakistan', 6945), ('time-lapse', 6946), ('powerful', 6947), ('lapsed', 6948), ('greyhound', 6949), ('creatures', 6950), ('hazard', 6951), ('railways', 6952), ('limbs', 6953), ('papered', 6954), ('crossroads', 6955), ('guided', 6956), ('again', 6957), ('crest', 6958), ('emerging', 6959), ('dumpster', 6960), ('rotting', 6961), ('pineapples', 6962), ('densely', 6963), ('horizontal', 6964), ('prominent', 6965), ('off-road', 6966), ('streak', 6967), ('crepe', 6968), ('markers', 6969), ('host', 6970), ('health', 6971), ('hydrogen', 6972), ('candies', 6973), ('-', 6974), ('canopies', 6975), ('loop', 6976), ('badly', 6977), ('weed', 6978), ('wreath', 6979), ('ducklings', 6980), ('multi-lane', 6981), ('logos', 6982), ('livestock', 6983), ('herder', 6984), ('john', 6985), ('picturesque', 6986), ('majestic', 6987), ('llamas', 6988), ('advertisements', 6989), ('squirrel', 6990), ('shorn', 6991), ('munches', 6992), ('galloping', 6993), ('leafless', 6994), ('gazelle', 6995), ('ion', 6996), ('ewe', 6997), ('staked', 6998), ('contrast', 6999), ('wades', 7000), ('vista', 7001), ('memory', 7002), ('peter', 7003), ('tours', 7004), ('trouble', 7005), ('staged', 7006), ('sites', 7007), ('waterhole', 7008), ('crosswalks', 7009), ('snowman', 7010), ('buttery', 7011), ('bushy', 7012), ('marshy', 7013), ('paddock', 7014), ('chevrolet', 7015), ('gazelles', 7016), ('nursing', 7017), ('olympics', 7018), ('trestle', 7019), ('frosty', 7020), ('bleachers', 7021), ('chinatown', 7022), ('announcing', 7023), ('interest', 7024), ('sheepdog', 7025), ('two-story', 7026), ('grassing', 7027), ('gushing', 7028), ('raises', 7029), ('receiving', 7030), ('collie', 7031), ('hyrdrant', 7032), ('olympic', 7033), ('shred', 7034), ('gnar', 7035), ('links', 7036), ('god', 7037), ('trucking', 7038), ('nailed', 7039), ('dandelions', 7040), ('whiskers', 7041), ('roam', 7042), ('rafts', 7043), ('pandas', 7044), ('guards', 7045), ('thank', 7046), ('unfolded', 7047), ('glows', 7048), ('atlanta', 7049), ('changed', 7050), ('fading', 7051), ('stomachs', 7052), ('gymnasium', 7053), ('vine', 7054), ('slacks', 7055), ('semi-truck', 7056), ('teammates', 7057), ('known', 7058), ('ollie', 7059), ('kangaroo', 7060), ('robin', 7061), ('intersecting', 7062), ('speak', 7063), ('trotting', 7064), ('robot', 7065), ('roundabout', 7066), ('mache', 7067), ('sands', 7068), ('bluff', 7069), ('hotels', 7070), ('penned', 7071), ('tokyo', 7072), ('seattle', 7073), ('secluded', 7074), ('butting', 7075), ('seafood', 7076), ('bound', 7077), ('crochet', 7078), ('happening', 7079), ('grows', 7080), ('wrestling', 7081), ('unlit', 7082), ('rowboats', 7083), ('shear', 7084), ('shears', 7085), ('dragon', 7086), ('haze', 7087), ('giraff', 7088), ('acting', 7089), ('greenish', 7090), ('swampy', 7091), ('barnyard', 7092), ('oakland', 7093), ('surveying', 7094), ('man-made', 7095), ('ballroom', 7096), ('mansion', 7097), ('17', 7098), ('chillin', 7099), ('g', 7100), ('gains', 7101), ('giraffee', 7102), ('idling', 7103), ('fish-eye', 7104), ('chaise', 7105), ('treetops', 7106), ('festive', 7107), ('trolleys', 7108), ('sucking', 7109), ('rhino', 7110), ('piggy', 7111), ('pigs', 7112), ('situation', 7113), ('barred', 7114), ('thicket', 7115), ('safeway', 7116), ('concert', 7117), ('seashore', 7118), ('landscaped', 7119), ('stagecoach', 7120), ('stree', 7121), ('rhinos', 7122), ('born', 7123), ('bowling', 7124), ('closer', 7125), ('pain', 7126), ('binoculars', 7127), ('merchandise', 7128), ('pirate', 7129), ('mommy', 7130), ('caps', 7131), ('manicure', 7132), ('steve', 7133), ('palms', 7134), ('inn', 7135), ('mode', 7136), ('multi-story', 7137), ('dolphins', 7138), ('e', 7139), ('petted', 7140), ('hammock', 7141), ('documents', 7142), ('pyramids', 7143), ('extend', 7144), ('supporting', 7145), ('correct', 7146), ('pursuit', 7147), ('rollerblading', 7148), ('formations', 7149), ('obscured', 7150), ('daily', 7151), ('headband', 7152), ('favorite', 7153), ('operated', 7154), ('chews', 7155), ('staying', 7156), ('cause', 7157), ('mules', 7158), ('danger', 7159), ('clippers', 7160), ('donkeys', 7161), ('directional', 7162), ('bagged', 7163), ('jumper', 7164), ('continues', 7165), ('nosing', 7166), ('wholly', 7167), ('snacking', 7168), ('munching', 7169), ('silo', 7170), ('coastline', 7171), ('copy', 7172), ('shakespeare', 7173), ('breeze', 7174), ('posting', 7175), ('navigate', 7176), ('husband', 7177), ('last', 7178), ('double-decked', 7179), ('samsung', 7180), ('mein', 7181), ('majestically', 7182), ('muzzled', 7183), ('blacktop', 7184), ('promotional', 7185), ('chew', 7186), ('creature', 7187), ('easily', 7188), ('scape', 7189), ('digs', 7190), ('frowning', 7191), ('submerged', 7192), ('operates', 7193), ('clipping', 7194), ('brimmed', 7195), ('schoolbus', 7196), ('smartphone', 7197), ('engraved', 7198), ('inscription', 7199), ('curbside', 7200), ('hollow', 7201), ('eatting', 7202), ('please', 7203), ('craggy', 7204), ('sex', 7205), ('fowl', 7206), ('hoof', 7207), ('manhattan', 7208), ('rooftops', 7209), ('theatre', 7210), ('hiker', 7211), ('nuzzles', 7212), ('snout', 7213), ('fountains', 7214), ('texas', 7215), ('butts', 7216), ('orphanage', 7217), ('proceeds', 7218), ('underbrush', 7219), ('plump', 7220), ('glaring', 7221), ('hogs', 7222), ('tugboat', 7223), ('happens', 7224), ('mates', 7225), ('asparagus', 7226), ('princess', 7227), ('picket', 7228), ('sightseeing', 7229), (\"'d\", 7230), ('grassed', 7231), ('bulldog', 7232), ('tablets', 7233), ('batman', 7234), ('temperature', 7235), ('ghost', 7236), ('came', 7237), ('specially', 7238), ('gracefully', 7239), ('bowing', 7240), ('awkward', 7241), ('elk', 7242), ('underway', 7243), ('exploring', 7244), ('nears', 7245), ('knelt', 7246), ('relaxed', 7247), ('manicured', 7248), ('mountaintop', 7249), ('destinations', 7250), ('spouting', 7251), ('pumpkins', 7252), ('cove', 7253), ('dries', 7254), ('florida', 7255), ('snowmobile', 7256), ('buliding', 7257), ('incoming', 7258), ('mating', 7259), ('roosters', 7260), ('bump', 7261), ('arid', 7262), ('moderate', 7263), ('serene', 7264), ('indicated', 7265), ('joy', 7266), ('victory', 7267), ('shores', 7268), ('clover', 7269), ('edible', 7270), ('steet', 7271), ('sunflowers', 7272), ('tide', 7273), ('pipeline', 7274), ('stranded', 7275), ('windmill', 7276), ('shacks', 7277), ('wolf', 7278), ('unhappy', 7279), ('hedges', 7280), ('scared', 7281), ('foilage', 7282), ('fir', 7283), ('slushy', 7284), ('blooms', 7285), ('entwined', 7286), ('hugged', 7287), ('puzzle', 7288), ('twigs', 7289), ('wizard', 7290), ('roots', 7291), ('hollywood', 7292), ('paths', 7293), ('farmhouse', 7294), ('cocking', 7295), ('drooping', 7296), ('pastor', 7297), ('exact', 7298), ('dug', 7299), ('bale', 7300), ('game..', 7301), ('awards', 7302), ('snuggles', 7303), ('grace', 7304), ('trooper', 7305), ('chart', 7306), ('branded', 7307), ('stony', 7308), ('settee', 7309), ('marking', 7310), ('anyone', 7311), ('shoots', 7312), ('sadly', 7313), ('hydrants', 7314), ('9', 7315), ('grid', 7316), ('buffalo', 7317), ('shorter', 7318), ('wildebeests', 7319), ('unattended', 7320), ('listens', 7321), ('moose', 7322), ('judge', 7323), ('crashing', 7324), ('thatched', 7325), ('collide', 7326), ('los', 7327), ('angeles', 7328), ('multistory', 7329), ('scanner', 7330), ('code', 7331), ('goal', 7332), ('splashes', 7333), ('thermos', 7334), ('potter', 7335), ('highest', 7336), ('longingly', 7337), ('cartoonish', 7338), ('licked', 7339), ('stooping', 7340), ('munch', 7341), ('grafitti', 7342), ('hide', 7343), ('exciting', 7344), ('55', 7345), ('sox', 7346), ('flyers', 7347), ('juts', 7348), ('stories', 7349), ('birdhouse', 7350), ('cannon', 7351), ('twig', 7352), ('anytime', 7353), ('predators', 7354), ('laps', 7355), ('antelopes', 7356), ('troll', 7357), ('suckles', 7358), ('nurses', 7359), ('frolic', 7360), ('original', 7361), ('compound', 7362), ('knows', 7363), ('operator', 7364), ('launched', 7365), ('tipped', 7366), ('nibble', 7367), ('crossroad', 7368), ('practices', 7369), ('rodeo', 7370), ('parasailing', 7371), ('hearty', 7372), ('youngster', 7373), ('lost', 7374), ('mills', 7375), ('woodland', 7376), ('underwater', 7377), ('blend', 7378), ('ballpark', 7379), ('hunting', 7380), ('roams', 7381), ('necked', 7382), ('stork', 7383), ('slit', 7384), ('routes', 7385), ('growth', 7386), ('singular', 7387), ('slap', 7388), ('kings', 7389), ('hummingbird', 7390), ('confinement', 7391), ('beaks', 7392), ('resembles', 7393), ('successful', 7394), ('marshmallows', 7395), ('released', 7396), ('1st', 7397), ('sprout', 7398), ('offspring', 7399), ('studies', 7400), ('trained', 7401), ('rugby', 7402), ('disney', 7403), ('lincoln', 7404), ('stumps', 7405), ('don', 7406), ('polar', 7407), ('jammed', 7408), ('paperback', 7409), ('development', 7410), ('oversize', 7411), ('indifferent', 7412), ('seaweed', 7413), ('connect', 7414), ('yawns', 7415), ('feeders', 7416), ('buddha', 7417), ('bucks', 7418), ('sweaters', 7419), ('rotunda', 7420), ('swimwear', 7421), ('buoys', 7422), ('cheeks', 7423), ('volley', 7424), ('garnish', 7425), ('stacking', 7426), ('ironic', 7427), ('firehydrant', 7428), ('alertly', 7429), ('unicorn', 7430), ('twirling', 7431), ('gaze', 7432), ('multi-level', 7433), ('unclear', 7434), ('flops', 7435), ('relief', 7436), ('incredible', 7437), ('neath', 7438), ('nights', 7439), ('quietly', 7440), ('coached', 7441), ('tins', 7442), ('junction', 7443), ('armrest', 7444), ('bulidings', 7445), ('criss', 7446), ('cocoa', 7447), ('avoiding', 7448), ('identically', 7449), ('involved', 7450), ('swiss', 7451), ('greets', 7452), ('toped', 7453), ('wiener', 7454), ('interact', 7455), ('slip', 7456), ('embankment', 7457), ('connects', 7458), ('splayed', 7459), ('gras', 7460), ('bead', 7461), ('overtop', 7462), ('developed', 7463), ('splits', 7464), ('bumps', 7465), ('stoops', 7466), ('groomed', 7467), ('trams', 7468), ('knoll', 7469), ('zipping', 7470), ('feild', 7471), ('width', 7472), ('dell', 7473), ('procedure', 7474), ('dwarfed', 7475), ('stay', 7476), ('territory', 7477), ('exceptionally', 7478), ('astounding', 7479), ('movement', 7480), ('fascinating', 7481), ('invisible', 7482), ('seeking', 7483), ('amazed', 7484), ('sodas', 7485), ('darkness', 7486), ('spend', 7487), ('handed', 7488), ('thorny', 7489), ('flea', 7490), ('mmm', 7491), ('mm', 7492), ('haul', 7493), ('field..', 7494), ('decks', 7495), ('bluebird', 7496), ('ruins', 7497), ('mowed', 7498), ('huts', 7499), ('cardinal', 7500), ('teens', 7501), ('vie', 7502), ('antlers', 7503), ('peaked', 7504), ('chance', 7505), ('locomotive', 7506), ('maneuvering', 7507), ('imitating', 7508), ('15', 7509), ('goodbye', 7510), ('corona', 7511), ('barbeque', 7512), ('zoomed', 7513), ('khaki', 7514), ('curls', 7515), ('bloom', 7516), ('well-made', 7517), ('cornfield', 7518), ('riverside', 7519), ('directed', 7520), ('atrium', 7521), ('rifle', 7522), ('plats', 7523), ('rapid', 7524), ('rapids', 7525), ('year', 7526), ('devil', 7527), ('focal', 7528), ('diesel', 7529), ('nigh', 7530), ('spans', 7531), ('q', 7532), ('dove', 7533), ('spins', 7534), ('cylinder', 7535), ('recognizable', 7536), ('pelicans', 7537), ('twins', 7538), ('patchwork', 7539), ('surprise', 7540), ('prices', 7541), ('sombrero', 7542), ('yes', 7543), ('snowsuit', 7544), ('bees', 7545), ('tiers', 7546), ('bugs', 7547), ('zombies', 7548), ('poised', 7549), ('bottoms', 7550), ('packet', 7551), ('chilly', 7552), ('wedge', 7553), ('buddy', 7554), ('scratches', 7555), ('blizzard', 7556), ('sweeper', 7557), ('od', 7558), ('measure', 7559), ('standng', 7560), ('affection', 7561), ('distinct', 7562), ('meets', 7563), ('stature', 7564), ('bid', 7565), ('canvas', 7566), ('shakes', 7567), ('victoria', 7568), ('nursery', 7569), ('pomeranian', 7570), ('satin', 7571), ('lattice', 7572), ('purchased', 7573), ('gallop', 7574), ('taps', 7575), ('concession', 7576), ('suites', 7577), ('forlorn', 7578), ('aloft', 7579), ('labrador', 7580), ('over-sized', 7581), ('driftwood', 7582), ('asking', 7583), ('x', 7584), ('rockefeller', 7585), ('unseen', 7586), ('bannister', 7587), ('maze', 7588), ('18', 7589), ('mallard', 7590), ('humming', 7591), ('clip', 7592), ('mile', 7593), ('jetty', 7594), ('placid', 7595), ('warns', 7596), ('hump', 7597), ('conductor', 7598), ('attractions', 7599), ('fe', 7600), ('guardrail', 7601), ('dr', 7602), ('swans', 7603), ('polaroid', 7604), ('breaks', 7605), ('34th', 7606), ('tugging', 7607), ('signed', 7608), ('politicians', 7609), ('spreads', 7610), ('talbot', 7611), ('platforms', 7612), ('germany', 7613), ('addresses', 7614), ('flapping', 7615), ('boxcar', 7616), ('bats', 7617), ('catchers', 7618), ('beaked', 7619), ('steams', 7620), ('elf', 7621), ('daffodils', 7622), ('ontop', 7623), ('f', 7624), ('philadelphia', 7625), ('scarecrow', 7626), ('forked', 7627), ('steers', 7628), ('trekking', 7629), ('pecking', 7630), ('pecks', 7631), ('baltimore', 7632), ('prominently', 7633), ('advertise', 7634), ('egret', 7635), ('breasted', 7636), ('sidwalk', 7637), ('watermelons', 7638), ('motoring', 7639), ('chicks', 7640), ('artsy', 7641), ('surgery', 7642), ('showed', 7643), ('admires', 7644), ('gulls', 7645), ('jay', 7646), ('loose', 7647), ('expo', 7648), ('chaps', 7649), ('roasted', 7650), ('listed', 7651), ('jones', 7652), ('chugging', 7653), ('chugs', 7654), ('amtrak', 7655), ('ability', 7656), ('beak', 7657), ('thomas', 7658), ('turbines', 7659), ('lodged', 7660), ('failing', 7661), ('coal', 7662), ('roping', 7663), ('choking', 7664), ('bone', 7665), ('marquee', 7666), ('false', 7667), ('pirates', 7668), ('realistic', 7669), ('dollars', 7670), ('ann', 7671), ('gowns', 7672), ('mothers', 7673), ('ivory', 7674), ('mock', 7675), ('gull', 7676), ('rd', 7677), ('30', 7678), ('bands', 7679), ('rays', 7680), ('defaced', 7681), ('puffs', 7682), ('peanuts', 7683), ('rhinoceros', 7684), ('5th', 7685), ('scrolling', 7686), ('boaters', 7687), ('lagoon', 7688), ('fifth', 7689), ('demonstrate', 7690), ('algae', 7691), ('crows', 7692), ('tundra', 7693), ('pawn', 7694), ('bourbon', 7695), ('3rd', 7696), ('homer', 7697), ('beware', 7698), ('flurry', 7699), ('wonderland', 7700), ('sledding', 7701), ('rolex', 7702), ('chilling', 7703), ('nectar', 7704), ('foamy', 7705), ('impressed', 7706), ('passage', 7707), ('atm', 7708), ('murky', 7709), ('press', 7710), ('chicago', 7711), ('science', 7712), ('vultures', 7713), ('competitive', 7714), ('waring', 7715), ('bra', 7716), ('traversing', 7717), ('experience', 7718), ('protester', 7719), ('dr.', 7720), ('trumpet', 7721), ('campaign', 7722), ('chased', 7723), ('handbags', 7724), ('peacocks', 7725), ('frolicking', 7726), ('bucking', 7727), ('lily', 7728), ('rodent', 7729), ('eyeballs', 7730), ('cheek', 7731), ('drifting', 7732), ('filmed', 7733), ('hen', 7734), ('interviewing', 7735), ('purchasing', 7736), ('award', 7737), ('dusted', 7738), ('sundown', 7739), ('railed', 7740), ('prince', 7741), ('nw', 7742), ('lemonade', 7743), ('buggies', 7744), ('overlooked', 7745), ('choo', 7746), ('feathery', 7747), ('pennsylvania', 7748), ('ave.', 7749), ('350', 7750), ('penalty', 7751), ('coop', 7752), ('veil', 7753), ('switching', 7754), ('furred', 7755), ('bail', 7756), ('coup', 7757), ('initials', 7758), ('teach', 7759), ('cupola', 7760), ('toronto', 7761), ('de', 7762), ('striking', 7763), ('gesturing', 7764), ('gallops', 7765), ('tusks', 7766), ('advancing', 7767), ('engineer', 7768), ('solar', 7769), ('strain', 7770), ('pugs', 7771), ('rue', 7772), ('protecting', 7773), ('infamous', 7774), ('condos', 7775), ('well-dressed', 7776), ('cowgirl', 7777), ('tee-shirt', 7778), ('icicles', 7779), ('rotating', 7780), ('thermometer', 7781), ('flamingos', 7782), ('madison', 7783), ('flesh', 7784), ('loses', 7785), ('stevens', 7786), ('6th', 7787), ('johns', 7788), ('website', 7789), ('elizabeth', 7790), ('never', 7791), ('whimsical', 7792), ('breeds', 7793), ('balck', 7794), ('carring', 7795), ('kill', 7796), ('quarter', 7797), ('core', 7798), ('murdered', 7799), ('heel', 7800), ('hound', 7801), ('treading', 7802), ('cupping', 7803), ('warms', 7804), ('continue', 7805), ('included', 7806), ('coconuts', 7807), ('bot', 7808), ('outcrop', 7809), ('boxcars', 7810), ('earbuds', 7811), ('reef', 7812), ('sunday', 7813), ('pools', 7814), ('becomes', 7815), ('bases', 7816), ('instructs', 7817), ('seuss', 7818), ('crook', 7819), ('sprinkling', 7820), ('corporate', 7821), ('pro', 7822), ('roasting', 7823), ('interacts', 7824), ('trot', 7825), ('score', 7826), ('raspberry', 7827), ('jockeys', 7828), ('retrieve', 7829), ('barrow', 7830), ('yaks', 7831), ('cowboys', 7832), ('miles', 7833), ('steamboat', 7834), ('beacon', 7835), ('cutouts', 7836), ('shapped', 7837), ('spell', 7838), ('gift', 7839), ('straightening', 7840), ('bonds', 7841), ('contained', 7842), ('tapping', 7843), ('swimmer', 7844), ('congress', 7845), ('erase', 7846), ('logging', 7847), ('suited', 7848), ('tug', 7849), ('lasso', 7850), ('triumphantly', 7851), ('mitts', 7852), ('valentine', 7853), ('draw', 7854), ('crumbled', 7855), ('embroidered', 7856), ('mic', 7857), ('broiled', 7858), ('shoveling', 7859), ('coconut', 7860), ('winnie', 7861), ('pooh', 7862), ('clinton', 7863), ('differnt', 7864), ('frothy', 7865), ('fluffed', 7866), ('afield', 7867), ('forklift', 7868), ('goo', 7869), ('winds', 7870), ('shovel', 7871), ('obscures', 7872), ('chewed', 7873), ('outward', 7874), ('parakeets', 7875), ('gardening', 7876), ('raggedy', 7877), ('confetti', 7878), ('composed', 7879), ('snuggle', 7880), ('scott', 7881), ('juices', 7882), ('brother', 7883), ('judges', 7884), ('cuckoo', 7885), ('decline', 7886), ('locomotives', 7887), ('upturned', 7888), ('torches', 7889), ('halved', 7890), ('consumption', 7891), ('buoy', 7892), ('rules', 7893), ('ending', 7894), ('ruby', 7895), ('bills', 7896), ('pearl', 7897), ('dew', 7898), ('deli', 7899), ('delight', 7900), ('intensely', 7901), ('hoody', 7902), ('winery', 7903), ('swung', 7904), ('subject', 7905), ('anime', 7906), ('dynamite', 7907), ('sil', 7908), ('dying', 7909), ('removes', 7910), ('al', 7911), ('p', 7912), ('plow', 7913), ('encased', 7914), ('taht', 7915), ('lorry', 7916), ('wintry', 7917), ('alarm', 7918), ('mare', 7919), ('ronald', 7920), ('feeling', 7921), ('dials', 7922), ('stuffing', 7923), ('wrist', 7924), ('elaborately', 7925), ('wide-eyed', 7926), ('cob', 7927), ('telescope', 7928), ('nike', 7929), ('friday', 7930), ('cologne', 7931), ('intriguing', 7932), ('photo-shopped', 7933), ('centers', 7934), ('latin', 7935), ('judged', 7936), ('longhorn', 7937), ('platters', 7938), ('delicate', 7939), ('summit', 7940), ('puddles', 7941), ('30th', 7942), ('remain', 7943), ('mate', 7944), ('outfield', 7945), ('external', 7946), ('crafted', 7947), ('fielder', 7948), ('enthusiastically', 7949), ('cracks', 7950), ('calls', 7951), ('ruffled', 7952), ('champagne', 7953), ('angrily', 7954), ('singer', 7955), ('gum', 7956), ('sweets', 7957), ('pudding', 7958), ('wilted', 7959), ('skim', 7960), ('thirteen', 7961), ('brace', 7962), ('foothills', 7963), ('battered', 7964), ('emo', 7965), ('lucky', 7966), ('clutching', 7967), ('counting', 7968), ('flowerpot', 7969), ('grimaces', 7970), ('colts', 7971), ('mayo', 7972), ('pitches', 7973), ('struggles', 7974), ('swords', 7975), ('drifts', 7976), ('triangles', 7977), ('computing', 7978), ('nudging', 7979), ('collecting', 7980), ('parasols', 7981), ('pinning', 7982), ('anticipating', 7983), ('brownie', 7984), ('politician', 7985), ('midday', 7986), ('returns', 7987), ('evergreens', 7988), ('personalized', 7989), ('manipulated', 7990), ('rancher', 7991), ('sweatpants', 7992), ('samples', 7993), ('lanterns', 7994), ('almonds', 7995), ('brochure', 7996), ('question', 7997), ('entertainer', 7998), ('carvings', 7999), ('13th', 8000), ('tack', 8001), ('rears', 8002), ('picker', 8003), ('bulldozer', 8004), ('armchair', 8005), ('wagons', 8006), ('slippery', 8007), ('kart', 8008), ('netbook', 8009), ('loveseat', 8010), ('hamster', 8011), ('hurt', 8012), ('courtroom', 8013), ('zippered', 8014), ('crawls', 8015), ('mooring', 8016), ('speared', 8017), ('aiming', 8018), ('equestrians', 8019), ('credit', 8020), ('wayland', 8021), ('michigan', 8022), ('refrigerated', 8023), ('ruck', 8024), ('guarding', 8025), ('tractors', 8026), ('diet', 8027), ('eighteen', 8028), ('myspace', 8029), ('calfs', 8030), ('futon', 8031), ('squints', 8032), ('whiskey', 8033), ('pinstriped', 8034), ('armored', 8035), ('alto', 8036), ('pinstripe', 8037), ('content', 8038), ('annual', 8039), ('detroit', 8040), ('thoughtful', 8041), ('smell', 8042), ('fez', 8043), ('tacos', 8044), ('pf', 8045), ('mike', 8046), ('dvds', 8047), ('auction', 8048), ('bracelet', 8049), ('twine', 8050), ('screaming', 8051), ('cal', 8052), ('strand', 8053), ('piers', 8054), ('foal', 8055), ('footstool', 8056), ('doily', 8057), ('sandal', 8058), ('shoelace', 8059), ('fifteen', 8060), ('haircut', 8061), ('caravan', 8062), ('bean', 8063), ('launching', 8064), ('tailgate', 8065), ('phrase', 8066), ('headgear', 8067), ('knocking', 8068), ('collector', 8069), ('tuxedos', 8070), ('mower', 8071), ('trainers', 8072), ('clicking', 8073), ('production', 8074), ('kayaks', 8075), ('ottoman', 8076), ('charlie', 8077), ('pepperoni', 8078), ('uhaul', 8079), ('lapel', 8080), ('catamaran', 8081), ('wrestle', 8082), ('backsides', 8083), ('colleagues', 8084), ('zombie', 8085), ('hitch', 8086), ('grasping', 8087), ('potato', 8088), ('fitting', 8089), ('hors', 8090), ('lakeside', 8091), ('chargers', 8092), ('pda', 8093), ('riverboat', 8094), ('amp', 8095), ('blenders', 8096), ('harper', 8097), ('consume', 8098), ('flotation', 8099), ('hamburgers', 8100), ('readying', 8101), ('tickets', 8102), ('brunch', 8103), ('ladybug', 8104), ('mousepad', 8105), ('ranger', 8106), ('blindfolded', 8107), ('mattresses', 8108), ('crepes', 8109), ('scout', 8110), ('thinly', 8111), ('flank', 8112), ('unzipped', 8113), ('stethoscope', 8114), ('modem', 8115), ('clowns', 8116), ('hippopotamus', 8117), ('amusing', 8118), ('guinness', 8119), ('descend', 8120), ('crossbones', 8121), ('gleefully', 8122), ('ledges', 8123), ('comfy', 8124), ('backlit', 8125), ('pencils', 8126), ('curiosity', 8127), ('strokes', 8128), ('smirk', 8129), ('rummaging', 8130), ('diorama', 8131), ('passport', 8132), ('lollipop', 8133), ('silk', 8134), ('actions', 8135), ('knotted', 8136), ('ice-cream', 8137), ('waterskiing', 8138), ('campground', 8139), ('wakeboarding', 8140), ('handlers', 8141), ('peripherals', 8142), ('yankees', 8143), ('email', 8144), ('ward', 8145), ('sown', 8146), ('selections', 8147), ('reporters', 8148), ('gondola', 8149), ('sunbathers', 8150), ('luncheon', 8151), ('bracelets', 8152), ('courch', 8153), ('gelato', 8154), ('professionals', 8155), ('stepped', 8156), ('gripping', 8157), ('mickey', 8158), ('ashore', 8159), ('backup', 8160), ('paisley', 8161), ('bud', 8162), ('headset', 8163), ('geek', 8164), ('slid', 8165), ('managing', 8166), ('koala', 8167), ('kayaking', 8168), ('operate', 8169), ('sixteen', 8170), ('watercraft', 8171), ('lunches', 8172), ('bridal', 8173), ('walkie', 8174), ('sailboard', 8175), ('dragged', 8176), ('scrambled', 8177), ('crumb', 8178), ('blackened', 8179), ('belong', 8180), ('hurry', 8181), ('drags', 8182), ('chunky', 8183), ('articles', 8184), ('applauding', 8185), ('fairy', 8186), ('hurdles', 8187), ('southwestern', 8188), ('seminar', 8189), ('crescent', 8190), ('croissants', 8191), ('chests', 8192), ('mittens', 8193), ('saddles', 8194), ('bunting', 8195), ('tried', 8196), ('crush', 8197), ('usb', 8198), ('unplugged', 8199), ('persian', 8200), ('29', 8201), ('checkpoint', 8202), ('tanning', 8203), ('cub', 8204), ('budweiser', 8205), ('greenhouse', 8206), ('mints', 8207), ('stake', 8208), ('postage', 8209), ('deformed', 8210), ('stamp', 8211), ('comforters', 8212), ('pensive', 8213), ('tupperware', 8214), ('knitting', 8215), ('houseboat', 8216), ('spool', 8217), ('crayons', 8218), ('pour', 8219), ('mild', 8220), ('skiff', 8221), ('pagoda', 8222), ('hyenas', 8223), ('landmark', 8224), ('dunking', 8225), ('claim', 8226), ('blouse', 8227), ('worshiping', 8228), ('wed', 8229), ('drizzling', 8230), ('tusked', 8231), ('heeled', 8232), ('lockers', 8233), ('snowshoes', 8234), ('briefcases', 8235), ('spectator', 8236), ('stooges', 8237), ('reacting', 8238), ('grizzly', 8239), ('boutonniere', 8240), ('dramatically', 8241), ('leggings', 8242), ('kilts', 8243), ('panda', 8244), ('sole', 8245), ('unidentifiable', 8246), ('tulips', 8247), ('booty', 8248), ('nightstands', 8249), ('returning', 8250), ('conveyer', 8251), ('bangs', 8252), ('retrieving', 8253), ('harbour', 8254), ('teeshirt', 8255), ('pilled', 8256), ('wardrobe', 8257), ('peson', 8258), ('cacti', 8259), ('tusk', 8260), ('goofing', 8261), ('recorder', 8262), ('roomful', 8263), ('ferret', 8264), ('demon', 8265), ('brings', 8266), ('yells', 8267), ('diapers', 8268), ('salvation', 8269), ('laser', 8270), ('wineglasses', 8271), ('broadly', 8272), ('attendees', 8273), ('wagging', 8274), ('punk', 8275), ('stylus', 8276), ('arrival', 8277), ('engage', 8278), ('growling', 8279), ('dancers', 8280), ('professionally', 8281), ('spear', 8282), ('treks', 8283), ('deflated', 8284), ('masts', 8285), ('frisbie', 8286), ('battleship', 8287), ('nerd', 8288), ('excitement', 8289), ('parliament', 8290), ('enjoyment', 8291), ('necklaces', 8292), ('dread', 8293), ('dreadlocks', 8294), ('prom', 8295), ('toasting', 8296), ('thigh', 8297), ('lavishly', 8298), ('paragliding', 8299), ('barbershop', 8300), ('keepers', 8301), ('gallon', 8302), ('kilt', 8303), ('pigtails', 8304), ('unwrapped', 8305), ('organic', 8306), ('retrieves', 8307), ('2013', 8308), ('sleeves', 8309), ('cultural', 8310), ('cross-legged', 8311), ('scarfs', 8312), ('teddybear', 8313), ('beachfront', 8314), ('sweaty', 8315), ('disco', 8316), ('organizing', 8317), ('carnations', 8318), ('winner', 8319), ('golfer', 8320), ('gummy', 8321), ('marriage', 8322), ('trophies', 8323), ('lampshade', 8324), ('grizzle', 8325), ('biscuits', 8326), ('minnie', 8327), ('jams', 8328), ('paddleboarding', 8329), ('kerry', 8330), ('colliding', 8331), ('padding', 8332), ('quantity', 8333), ('won', 8334), ('frisby', 8335), ('despite', 8336), ('freez', 8337), ('arrayed', 8338), ('sprints', 8339), ('talbe', 8340), ('trombone', 8341), ('inset', 8342), ('slabs', 8343), ('delicacy', 8344), ('helped', 8345), ('smith', 8346), ('calzone', 8347), ('vegetated', 8348), ('fort', 8349), ('hikes', 8350), ('strapping', 8351), ('accompany', 8352), ('pondering', 8353), ('tiara', 8354), ('stealing', 8355), ('variations', 8356), ('braces', 8357), ('onesie', 8358), ('faux', 8359), ('tempting', 8360), ('enjoyed', 8361), ('parasail', 8362), ('dj', 8363), ('waffle', 8364), ('sharpie', 8365), ('lanyard', 8366), ('flutes', 8367), ('whiteboard', 8368), ('aggressively', 8369), ('amateur', 8370), ('chestnut', 8371), ('spin', 8372), ('wheelchairs', 8373), ('quesadilla', 8374), ('slalom', 8375), ('cucumber', 8376), ('mit', 8377), ('lack', 8378), ('stables', 8379), ('tournament', 8380), ('peal', 8381), ('dodgers', 8382), ('topper', 8383), ('baseman', 8384), ('nutritious', 8385), ('skiier', 8386), ('actively', 8387), ('indians', 8388), ('mid-jump', 8389), ('misses', 8390), ('cricket', 8391), ('successfully', 8392), ('skiiing', 8393), ('zucchini', 8394), ('teammate', 8395), ('plentiful', 8396), ('ballgame', 8397), ('processing', 8398), ('choosing', 8399), ('wakeboard', 8400), ('walnuts', 8401), ('staning', 8402), ('pecans', 8403), ('bannanas', 8404), ('envelopes', 8405), ('mangos', 8406), ('flavors', 8407), ('taught', 8408), ('combed', 8409), ('bridled', 8410), ('firsbee', 8411), ('unpeeled', 8412), ('curry', 8413), ('flippers', 8414), ('dodging', 8415), ('tucks', 8416), ('teachers', 8417), ('ripening', 8418), ('biathlon', 8419), ('venturing', 8420), ('chiquita', 8421), ('knights', 8422), ('skilled', 8423), ('referee', 8424), ('swerving', 8425), ('vying', 8426), ('waffles', 8427), ('fingertips', 8428), ('ravioli', 8429), ('overhand', 8430), ('lessons', 8431), ('ceramics', 8432), ('peperoni', 8433), ('launches', 8434), ('fives', 8435), ('salami', 8436), ('kale', 8437), ('sweating', 8438), ('disks', 8439), ('chilli', 8440), ('eager', 8441), ('smothered', 8442), ('apricots', 8443), ('patty', 8444), ('infield', 8445), ('stroke', 8446), ('concentrates', 8447), ('pillowcases', 8448), ('adidas', 8449), ('spider', 8450), ('lunging', 8451), ('clippings', 8452), ('plantain', 8453), ('raring', 8454), ('entrees', 8455), ('vitamins', 8456), ('souffle', 8457), ('orioles', 8458), ('lesson', 8459), ('fishnet', 8460), ('gain', 8461), ('kiteboarding', 8462), ('uneaten', 8463), ('diced', 8464), ('aimed', 8465), ('cauliflower', 8466), ('raisins', 8467), ('sparkler', 8468), ('sandwhich', 8469), ('giants', 8470), ('ducking', 8471), ('skying', 8472), ('experiment', 8473), ('contending', 8474), ('pretzels', 8475), ('browned', 8476), ('stir-fry', 8477), ('cinnamon', 8478), ('elbows', 8479), ('ref', 8480), ('take-out', 8481), ('para-sailing', 8482), ('custard', 8483), ('50th', 8484), ('leeks', 8485), ('appetizers', 8486), ('ripeness', 8487), ('barry', 8488), ('blindfold', 8489), ('goblet', 8490), ('quiche', 8491), ('stabbing', 8492), ('livingroom', 8493), ('blinder', 8494), ('challenging', 8495), ('bandage', 8496), ('spicy', 8497), ('goalie', 8498), ('soccor', 8499), ('forehand', 8500), ('hil', 8501), ('payer', 8502), ('chilled', 8503), ('determined', 8504), ('tilts', 8505), ('vegitables', 8506), ('sour', 8507), ('kraut', 8508), ('florets', 8509), ('cranberry', 8510), ('skewers', 8511), ('empire', 8512), ('blueberry', 8513), ('windup', 8514), ('sauerkraut', 8515), ('skewered', 8516), ('sesame', 8517), ('chickpeas', 8518), ('shoved', 8519), ('congratulating', 8520), ('sauteed', 8521), ('pita', 8522), ('halfpipe', 8523), ('cheeses', 8524), ('pesto', 8525), ('delectable', 8526), ('salsa', 8527), ('pastrami', 8528), ('demonstrates', 8529), ('parmesan', 8530), ('protein', 8531), ('spaghetti', 8532), ('buttered', 8533), ('individually', 8534), ('lo', 8535), ('autographs', 8536), ('mlb', 8537), ('powdery', 8538), ('omelette', 8539), ('skill', 8540), ('crowns', 8541), ('flavor', 8542), ('bullpen', 8543), ('dumplings', 8544), ('spandex', 8545), ('crests', 8546), ('kickflip', 8547), ('bento', 8548), ('slaw', 8549), ('dunkin', 8550), ('smoked', 8551), ('completes', 8552), ('cornbread', 8553), ('pealed', 8554), ('winners', 8555), ('prizes', 8556), ('snowsuits', 8557), ('cheers', 8558), ('bagels', 8559), ('sleds', 8560), ('aim', 8561), ('tartar', 8562), ('flatbread', 8563), ('pomegranates', 8564), ('cheesy', 8565), ('patties', 8566), ('alfalfa', 8567), ('almond', 8568), ('crusted', 8569), ('broiler', 8570), ('submarine', 8571), ('greasy', 8572), ('polish', 8573), ('kneepads', 8574), ('crater', 8575), ('pasty', 8576), ('nachos', 8577), ('cut-up', 8578), ('cashews', 8579), ('fixings', 8580), ('meatloaf', 8581), ('mozzarella', 8582), ('cheddar', 8583), ('canes', 8584), ('soups', 8585), ('pretzel', 8586), ('wafer', 8587), ('milkshake', 8588), ('broccolli', 8589), ('cranberries', 8590), ('swirl', 8591), ('half-pipe', 8592), ('pickled', 8593), ('grated', 8594), ('floret', 8595), ('latte', 8596), ('cubed', 8597), ('chose', 8598), ('preforms', 8599), ('meatballs', 8600), ('spears', 8601), ('subs', 8602), ('mid-swing', 8603), ('fabulous', 8604), ('tots', 8605), ('mitten', 8606), ('pate', 8607), ('cole', 8608), ('stabbed', 8609), ('sprouting', 8610), ('burrito', 8611), ('skii', 8612), ('turnips', 8613), ('snowmen', 8614), ('cough', 8615), ('climber', 8616), ('exercises', 8617), ('artisan', 8618), ('skateboarded', 8619), ('marinara', 8620), ('scallops', 8621), ('attractively', 8622), ('condom', 8623), ('crispy', 8624), ('gerbil', 8625), ('waxed', 8626), ('meatball', 8627), ('croutons', 8628), ('baguette', 8629), ('plying', 8630), ('homeplate', 8631), ('panini', 8632), ('ribs', 8633), ('rye', 8634), ('nordic', 8635), ('graham', 8636), ('skate-park', 8637), ('goblets', 8638), ('wielding', 8639), ('outs', 8640), ('hashbrowns', 8641), ('baggy', 8642), ('partner', 8643), ('danish', 8644), ('coasters', 8645), ('cartons', 8646), ('tinfoil', 8647), ('blt', 8648), ('messily', 8649), ('popsicle', 8650), ('ciabatta', 8651), ('sugary', 8652), ('swirled', 8653), ('sandwhiches', 8654), ('leaguer', 8655), ('porcupine', 8656), ('mariners', 8657), ('footlong', 8658), ('plater', 8659), ('wreaths', 8660), ('jello', 8661), ('expert', 8662), ('enthusiast', 8663), ('meaty', 8664), ('oj', 8665), ('skimpy', 8666), ('marmalade', 8667), ('siblings', 8668), ('collectible', 8669), ('opponents', 8670), ('vegan', 8671), ('circuit', 8672), ('plaques', 8673), ('artichokes', 8674), ('sanctioned', 8675), ('confection', 8676), ('candlelight', 8677), ('tabe', 8678), ('sustenance', 8679), ('focuses', 8680), ('bartender', 8681), ('vigorously', 8682), ('candlesticks', 8683), ('toothpick', 8684), ('bonsai', 8685), ('styling', 8686), ('tomatos', 8687), ('urns', 8688), ('tarts', 8689), ('hi', 8690), ('open-faced', 8691), ('shoeless', 8692), ('carafe', 8693), ('contemplates', 8694), ('sprinkle', 8695), ('t-ball', 8696), ('receipt', 8697), ('hot-dog', 8698), ('windsurfer', 8699), ('newlywed', 8700), ('windsurfing', 8701), ('sugared', 8702), ('unbaked', 8703), ('app', 8704), ('condiment', 8705), ('crusts', 8706), ('corned', 8707), ('mayonnaise', 8708), ('sideboard', 8709), ('bratwurst', 8710), ('slathered', 8711), ('partaking', 8712), ('waxing', 8713), ('grease', 8714), ('wakeboarder', 8715), ('untouched', 8716), ('parasailer', 8717), ('chocolate-covered', 8718), ('creamer', 8719), ('liquids', 8720), ('cheer', 8721), ('nerf', 8722), ('fritter', 8723), ('surfboarder', 8724), ('dribbles', 8725), ('parasails', 8726), ('martini', 8727), ('dribbling', 8728), ('soccerball', 8729), ('boad', 8730), ('sloppy', 8731), ('cresting', 8732), ('calzones', 8733), ('dunk', 8734), ('chees', 8735), ('tonight', 8736), ('cappuccino', 8737), ('oreo', 8738), ('glazing', 8739), ('poppy', 8740), ('crusty', 8741), ('windsurfers', 8742), ('kitesurfing', 8743), ('arugula', 8744), ('grandmother', 8745), ('gauze', 8746), ('tweezers', 8747), ('wrenches', 8748), ('bubbly', 8749), ('tomatoe', 8750), ('gyro', 8751), ('dougnuts', 8752), ('barbecued', 8753), ('simulator', 8754), ('slam', 8755), ('anchovies', 8756), ('reacts', 8757), ('surfboarders', 8758), ('expertly', 8759), ('para-sail', 8760), ('calories', 8761), ('windsurfs', 8762), ('para-surfing', 8763), ('mosquito', 8764), ('attempted', 8765), ('baseline', 8766), ('shelve', 8767), ('1971', 8768), ('made-up', 8769), ('margherita', 8770), ('sibling', 8771), ('sparklers', 8772), ('pepperonis', 8773), ('returned', 8774), ('misshapen', 8775), ('raquet', 8776), ('mario', 8777), ('teresa', 8778), ('programming', 8779), ('daybed', 8780), ('blast', 8781), ('fiving', 8782), ('whites', 8783), ('technological', 8784), ('partners', 8785), ('prosciutto', 8786), ('jointly', 8787), ('tastefully', 8788), ('bodyboarding', 8789), ('bassinet', 8790), ('supreme', 8791), ('grimacing', 8792), ('swaddled', 8793), ('approval', 8794), ('ipads', 8795), ('rackett', 8796), ('clams', 8797), ('lapt', 8798), ('mantel', 8799), ('motes', 8800), ('peripheral', 8801), ('textbook', 8802), ('mote', 8803), ('wiimote', 8804), ('boxing', 8805), ('wii-mote', 8806), ('nunchuck', 8807), ('playstation', 8808), ('valentines', 8809), ('curio', 8810), ('thames', 8811), ('interactive', 8812), ('ergonomic', 8813), ('bristles', 8814), ('cordless', 8815), ('colgate', 8816), ('pendulum', 8817), ('alien', 8818), ('videogame', 8819), ('nokia', 8820), ('wi', 8821), ('icons', 8822), ('answering', 8823), ('workings', 8824), ('combs', 8825), ('coo', 8826), ('calculators', 8827), ('ottomans', 8828), ('floss', 8829), ('clipboard', 8830), ('talkie', 8831), ('mini-fridge', 8832), ('motorola', 8833), ('refrigeration', 8834), ('graduate', 8835), ('charms', 8836), ('daisy', 8837), ('application', 8838), ('sleeved', 8839), ('vein', 8840), ('carnation', 8841), ('mixers', 8842), ('dial', 8843), ('spools', 8844), ('wilting', 8845), ('cutters', 8846), ('pinking', 8847), ('rulers', 8848), ('puncher', 8849), ('bouquets', 8850), ('seniors', 8851), ('dandelion', 8852), ('coupons', 8853), ('cheerleader', 8854)])"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#vr\n",
    "data_loader.dataset.vocab.word2idx.items()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[('<start>', 0),\n",
       " ('<end>', 1),\n",
       " ('<unk>', 2),\n",
       " ('a', 3),\n",
       " ('very', 4),\n",
       " ('clean', 5),\n",
       " ('and', 6),\n",
       " ('well', 7),\n",
       " ('decorated', 8),\n",
       " ('empty', 9),\n",
       " ('bathroom', 10),\n",
       " ('panoramic', 11),\n",
       " ('view', 12),\n",
       " ('of', 13),\n",
       " ('kitchen', 14),\n",
       " ('all', 15),\n",
       " ('its', 16),\n",
       " ('appliances', 17),\n",
       " ('.', 18),\n",
       " ('blue', 19),\n",
       " ('white', 20),\n",
       " ('with', 21),\n",
       " ('butterfly', 22),\n",
       " ('themed', 23),\n",
       " ('wall', 24),\n",
       " ('tiles', 25),\n",
       " ('photo', 26),\n",
       " ('dining', 27),\n",
       " ('room', 28),\n",
       " ('stop', 29),\n",
       " ('sign', 30),\n",
       " ('across', 31),\n",
       " ('the', 32),\n",
       " ('street', 33),\n",
       " ('from', 34),\n",
       " ('red', 35),\n",
       " ('car', 36),\n",
       " ('vandalized', 37),\n",
       " ('beetle', 38),\n",
       " ('on', 39),\n",
       " ('road', 40),\n",
       " ('border', 41),\n",
       " ('butterflies', 42),\n",
       " ('paint', 43),\n",
       " ('walls', 44),\n",
       " ('above', 45),\n",
       " ('it', 46),\n",
       " ('an', 47),\n",
       " ('angled', 48),\n",
       " ('beautifully', 49),\n",
       " ('two', 50),\n",
       " ('people', 51),\n",
       " ('are', 52),\n",
       " ('walking', 53),\n",
       " ('down', 54),\n",
       " ('beach', 55),\n",
       " ('sink', 56),\n",
       " ('toilet', 57),\n",
       " ('inside', 58),\n",
       " ('small', 59),\n",
       " ('black', 60),\n",
       " ('square', 61),\n",
       " ('tile', 62),\n",
       " ('floor', 63),\n",
       " ('that', 64),\n",
       " ('needs', 65),\n",
       " ('repairs', 66),\n",
       " ('vanity', 67),\n",
       " ('contains', 68),\n",
       " ('sinks', 69),\n",
       " ('towel', 70),\n",
       " ('for', 71),\n",
       " ('each', 72),\n",
       " ('several', 73),\n",
       " ('metal', 74),\n",
       " ('balls', 75),\n",
       " ('sit', 76),\n",
       " ('in', 77),\n",
       " ('sand', 78),\n",
       " ('near', 79),\n",
       " ('group', 80),\n",
       " ('carrying', 81),\n",
       " ('surf', 82),\n",
       " ('boards', 83),\n",
       " ('brown', 84),\n",
       " ('cabinets', 85),\n",
       " (',', 86),\n",
       " ('backsplash', 87),\n",
       " ('grey', 88),\n",
       " ('counters', 89),\n",
       " ('surfer', 90),\n",
       " ('woman', 91),\n",
       " ('child', 92),\n",
       " ('walk', 93),\n",
       " ('few', 94),\n",
       " ('dim', 95),\n",
       " ('transportation', 96),\n",
       " ('system', 97),\n",
       " ('person', 98),\n",
       " ('protected', 99),\n",
       " ('rain', 100),\n",
       " ('by', 101),\n",
       " ('their', 102),\n",
       " ('umbrella', 103),\n",
       " ('walks', 104),\n",
       " ('has', 105),\n",
       " ('interesting', 106),\n",
       " ('women', 107),\n",
       " ('preparing', 108),\n",
       " ('food', 109),\n",
       " ('one', 110),\n",
       " ('at', 111),\n",
       " ('table', 112),\n",
       " ('home', 113),\n",
       " ('light', 114),\n",
       " ('cat', 115),\n",
       " ('stuck', 116),\n",
       " ('slightly', 117),\n",
       " ('opened', 118),\n",
       " ('window', 119),\n",
       " ('bicycles', 120),\n",
       " ('front', 121),\n",
       " ('shop', 122),\n",
       " ('green', 123),\n",
       " ('tiled', 124),\n",
       " ('highlighted', 125),\n",
       " ('low', 126),\n",
       " ('overhead', 127),\n",
       " ('lighting', 128),\n",
       " ('bicycle', 129),\n",
       " ('is', 130),\n",
       " ('parked', 131),\n",
       " ('bench', 132),\n",
       " ('night', 133),\n",
       " ('horse', 134),\n",
       " ('grazing', 135),\n",
       " ('grass', 136),\n",
       " ('house', 137),\n",
       " ('someone', 138),\n",
       " ('riding', 139),\n",
       " ('bike', 140),\n",
       " ('pedestal', 141),\n",
       " ('located', 142),\n",
       " ('poorly', 143),\n",
       " ('lit', 144),\n",
       " ('this', 145),\n",
       " ('pick-up', 146),\n",
       " ('game', 147),\n",
       " ('shirts', 148),\n",
       " ('basketball', 149),\n",
       " ('bathtub', 150),\n",
       " ('shower', 151),\n",
       " ('mirror', 152),\n",
       " ('cabinet', 153),\n",
       " ('countertop', 154),\n",
       " ('includes', 155),\n",
       " ('apple', 156),\n",
       " ('phone', 157),\n",
       " ('teenagers', 158),\n",
       " ('surfboards', 159),\n",
       " ('his', 160),\n",
       " ('to', 161),\n",
       " ('indoor', 162),\n",
       " ('good', 163),\n",
       " ('closeup', 164),\n",
       " ('fire', 165),\n",
       " ('hydrant', 166),\n",
       " ('including', 167),\n",
       " ('chains', 168),\n",
       " ('man', 169),\n",
       " ('standing', 170),\n",
       " ('arms', 171),\n",
       " ('crossed', 172),\n",
       " ('purple', 173),\n",
       " ('bus', 174),\n",
       " ('dressed', 175),\n",
       " ('as', 176),\n",
       " ('nun', 177),\n",
       " ('tall', 178),\n",
       " ('herb', 179),\n",
       " ('toaster', 180),\n",
       " ('oven', 181),\n",
       " ('lady', 182),\n",
       " ('purse', 183),\n",
       " ('along', 184),\n",
       " ('side', 185),\n",
       " ('brightly', 186),\n",
       " ('colored', 187),\n",
       " ('wide', 188),\n",
       " ('angle', 189),\n",
       " ('work', 190),\n",
       " ('area', 191),\n",
       " ('around', 192),\n",
       " ('many', 193),\n",
       " ('silver', 194),\n",
       " ('round', 195),\n",
       " ('ground', 196),\n",
       " ('working', 197),\n",
       " ('counter', 198),\n",
       " ('illuminated', 199),\n",
       " ('sunlight', 200),\n",
       " ('granite', 201),\n",
       " ('countertops', 202),\n",
       " ('skinny', 203),\n",
       " ('field', 204),\n",
       " ('seagulls', 205),\n",
       " ('flying', 206),\n",
       " ('while', 207),\n",
       " ('trucks', 208),\n",
       " ('parking', 209),\n",
       " ('lot', 210),\n",
       " ('no', 211),\n",
       " ('doors', 212),\n",
       " ('dishwasher', 213),\n",
       " ('refrigerator', 214),\n",
       " ('modern', 215),\n",
       " ('glass', 216),\n",
       " ('pieces', 217),\n",
       " ('demonstration', 218),\n",
       " ('maintained', 219),\n",
       " ('hotel', 220),\n",
       " ('making', 221),\n",
       " ('angry', 222),\n",
       " ('face', 223),\n",
       " ('sitting', 224),\n",
       " ('motel', 225),\n",
       " ('nice', 226),\n",
       " ('hood', 227),\n",
       " ('city', 228),\n",
       " ('sidewalk', 229),\n",
       " ('lined', 230),\n",
       " ('lamp', 231),\n",
       " ('posts', 232),\n",
       " ('tv', 233),\n",
       " ('public', 234),\n",
       " ('restroom', 235),\n",
       " ('been', 236),\n",
       " ('photographed', 237),\n",
       " ('sepia', 238),\n",
       " ('old', 239),\n",
       " ('styled', 240),\n",
       " ('what', 241),\n",
       " ('appears', 242),\n",
       " ('be', 243),\n",
       " ('golden', 244),\n",
       " ('gate', 245),\n",
       " ('bridge', 246),\n",
       " ('peeking', 247),\n",
       " ('out', 248),\n",
       " ('rolled', 249),\n",
       " ('there', 250),\n",
       " ('some', 251),\n",
       " ('pet', 252),\n",
       " ('young', 253),\n",
       " ('boy', 254),\n",
       " ('surfing', 255),\n",
       " ('waves', 256),\n",
       " ('top', 257),\n",
       " ('covered', 258),\n",
       " ('brass', 259),\n",
       " ('pots', 260),\n",
       " ('pans', 261),\n",
       " ('shaving', 262),\n",
       " ('her', 263),\n",
       " ('wooden', 264),\n",
       " ('sky', 265),\n",
       " ('full', 266),\n",
       " ('colorful', 267),\n",
       " ('kites', 268),\n",
       " ('mountain', 269),\n",
       " ('rides', 270),\n",
       " ('river', 271),\n",
       " ('stand', 272),\n",
       " ('lights', 273),\n",
       " ('cupboard', 274),\n",
       " ('raft', 275),\n",
       " ('atop', 276),\n",
       " ('boat', 277),\n",
       " ('water', 278),\n",
       " ('cars', 279),\n",
       " ('trash', 280),\n",
       " ('can', 281),\n",
       " ('garage', 282),\n",
       " ('shorts', 283),\n",
       " ('seat', 284),\n",
       " ('looking', 285),\n",
       " ('jumping', 286),\n",
       " ('onto', 287),\n",
       " ('folded', 288),\n",
       " ('balancing', 289),\n",
       " ('image', 290),\n",
       " ('children', 291),\n",
       " ('paying', 292),\n",
       " ('attention', 293),\n",
       " ('up', 294),\n",
       " ('mill', 295),\n",
       " ('about', 296),\n",
       " ('background', 297),\n",
       " ('compact', 298),\n",
       " ('mounted', 299),\n",
       " ('roof', 300),\n",
       " ('crisp', 301),\n",
       " ('neutral', 302),\n",
       " ('embellished', 303),\n",
       " ('scene', 304),\n",
       " ('stainless', 305),\n",
       " ('steel', 306),\n",
       " ('appliance', 307),\n",
       " ('checkered', 308),\n",
       " ('pattern', 309),\n",
       " ('talking', 310),\n",
       " ('self', 311),\n",
       " ('portrait', 312),\n",
       " ('fancy', 313),\n",
       " ('cell', 314),\n",
       " ('accessories', 315),\n",
       " ('set', 316),\n",
       " ('without', 317),\n",
       " ('snowy', 318),\n",
       " ('skis', 319),\n",
       " ('towels', 320),\n",
       " ('laid', 321),\n",
       " ('stuffed', 322),\n",
       " ('animal', 323),\n",
       " ('laying', 324),\n",
       " ('bed', 325),\n",
       " ('sits', 326),\n",
       " ('open', 327),\n",
       " ('plates', 328),\n",
       " ('vegetables', 329),\n",
       " ('couple', 330),\n",
       " ('toilette', 331),\n",
       " ('computer', 332),\n",
       " ('taking', 333),\n",
       " ('picture', 334),\n",
       " ('large', 335),\n",
       " ('hours', 336),\n",
       " ('eating', 337),\n",
       " ('blurry', 338),\n",
       " ('rider', 339),\n",
       " ('zooms', 340),\n",
       " ('past', 341),\n",
       " ('new', 342),\n",
       " ('mercedes', 343),\n",
       " ('skiers', 344),\n",
       " ('peak', 345),\n",
       " ('thee', 346),\n",
       " ('cats', 347),\n",
       " ('sleeping', 348),\n",
       " ('featuring', 349),\n",
       " ('everything', 350),\n",
       " ('lies', 351),\n",
       " ('smaller', 352),\n",
       " ('ball', 353),\n",
       " ('board', 354),\n",
       " ('playing', 355),\n",
       " ('frisbee', 356),\n",
       " ('washing', 357),\n",
       " ('dishes', 358),\n",
       " ('backpack', 359),\n",
       " ('holding', 360),\n",
       " ('arm', 361),\n",
       " ('shoulders', 362),\n",
       " ('girl', 363),\n",
       " ('next', 364),\n",
       " ('him', 365),\n",
       " ('three', 366),\n",
       " ('owners', 367),\n",
       " ('using', 368),\n",
       " ('go', 369),\n",
       " ('baby', 370),\n",
       " ('dog', 371),\n",
       " ('clock', 372),\n",
       " ('hangs', 373),\n",
       " ('multiple', 374),\n",
       " ('photos', 375),\n",
       " ('extends', 376),\n",
       " ('hand', 377),\n",
       " ('catch', 378),\n",
       " ('silverware', 379),\n",
       " ('glasses', 380),\n",
       " ('bottle', 381),\n",
       " ('wine', 382),\n",
       " ('vegetable', 383),\n",
       " ('age', 384),\n",
       " ('equipment', 385),\n",
       " ('kite', 386),\n",
       " ('shape', 387),\n",
       " ('bottom', 388),\n",
       " ('half', 389),\n",
       " ('fashioned', 390),\n",
       " ('ware', 391),\n",
       " ('middle', 392),\n",
       " ('croquet', 393),\n",
       " ('painted', 394),\n",
       " ('does', 395),\n",
       " ('trick', 396),\n",
       " ('surfboard', 397),\n",
       " ('under', 398),\n",
       " ('bunch', 399),\n",
       " ('strapped', 400),\n",
       " ('six', 401),\n",
       " ('time', 402),\n",
       " ('riders', 403),\n",
       " ('goes', 404),\n",
       " ('shot', 405),\n",
       " ('laundry', 406),\n",
       " ('bear', 407),\n",
       " (\"'s\", 408),\n",
       " ('other', 409),\n",
       " ('places', 410),\n",
       " ('friend', 411),\n",
       " ('seagull', 412),\n",
       " ('perches', 413),\n",
       " ('van', 414),\n",
       " ('parachutes', 415),\n",
       " ('fly', 416),\n",
       " ('through', 417),\n",
       " ('girls', 418),\n",
       " ('lunch', 419),\n",
       " ('stocked', 420),\n",
       " ('supplies', 421),\n",
       " ('dish', 422),\n",
       " ('chef', 423),\n",
       " ('opens', 424),\n",
       " ('beside', 425),\n",
       " ('island', 426),\n",
       " ('random', 427),\n",
       " ('being', 428),\n",
       " ('prepared', 429),\n",
       " ('get', 430),\n",
       " ('newly', 431),\n",
       " ('family', 432),\n",
       " ('dirty', 433),\n",
       " ('clothes', 434),\n",
       " ('over', 435),\n",
       " ('edge', 436),\n",
       " ('body', 437),\n",
       " ('sun', 438),\n",
       " ('sets', 439),\n",
       " ('windows', 440),\n",
       " ('poses', 441),\n",
       " ('hill', 442),\n",
       " ('demonstrating', 443),\n",
       " ('act', 444),\n",
       " ('shelves', 445),\n",
       " ('wood', 446),\n",
       " ('assorted', 447),\n",
       " ('decorations', 448),\n",
       " ('plastic', 449),\n",
       " ('tarp', 450),\n",
       " ('courtyard', 451),\n",
       " ('reaches', 452),\n",
       " ('wave', 453),\n",
       " ('men', 454),\n",
       " ('seems', 455),\n",
       " ('others', 456),\n",
       " ('stairs', 457),\n",
       " ('lead', 458),\n",
       " ('double', 459),\n",
       " ('into', 460),\n",
       " ('footed', 461),\n",
       " ('tub', 462),\n",
       " ('bush', 463),\n",
       " ('bumper', 464),\n",
       " ('sticker', 465),\n",
       " ('word', 466),\n",
       " ('buffet', 467),\n",
       " ('different', 468),\n",
       " ('types', 469),\n",
       " ('organized', 470),\n",
       " ('closet', 471),\n",
       " ('female', 472),\n",
       " ('student', 473),\n",
       " ('bowls', 474),\n",
       " ('microwave', 475),\n",
       " ('storefronts', 476),\n",
       " ('right', 477),\n",
       " ('platform', 478),\n",
       " ('silhouette', 479),\n",
       " ('sunset', 480),\n",
       " ('tent', 481),\n",
       " ('stationed', 482),\n",
       " ('lane', 483),\n",
       " ('bath', 484),\n",
       " ('rug', 485),\n",
       " ('pile', 486),\n",
       " ('bikes', 487),\n",
       " ('rack', 488),\n",
       " ('outside', 489),\n",
       " ('stools', 490),\n",
       " ('takes', 491),\n",
       " ('selfie', 492),\n",
       " ('wrapped', 493),\n",
       " ('chain', 494),\n",
       " ('evergreen', 495),\n",
       " ('sprig', 496),\n",
       " ('grazes', 497),\n",
       " ('trees', 498),\n",
       " ('dogs', 499),\n",
       " ('beneath', 500),\n",
       " ('owner', 501),\n",
       " ('pristine', 502),\n",
       " ('waiting', 503),\n",
       " ('used', 504),\n",
       " ('smiles', 505),\n",
       " ('who', 506),\n",
       " ('wearing', 507),\n",
       " ('together', 508),\n",
       " ('enjoying', 509),\n",
       " ('company', 510),\n",
       " ('crowd', 511),\n",
       " ('prepare', 512),\n",
       " ('ski', 513),\n",
       " ('snow', 514),\n",
       " ('slopes', 515),\n",
       " ('video', 516),\n",
       " ('skiiers', 517),\n",
       " ('gathered', 518),\n",
       " ('base', 519),\n",
       " ('travel', 520),\n",
       " ('guy', 521),\n",
       " ('building', 522),\n",
       " ('another', 523),\n",
       " ('shave', 524),\n",
       " ('back', 525),\n",
       " ('neatly', 526),\n",
       " ('stacked', 527),\n",
       " ('shelf', 528),\n",
       " ('played', 529),\n",
       " ('yard', 530),\n",
       " ('copper', 531),\n",
       " ('pot', 532),\n",
       " ('racks', 533),\n",
       " ('stove', 534),\n",
       " ('restaurant', 535),\n",
       " ('filled', 536),\n",
       " ('watches', 537),\n",
       " ('boys', 538),\n",
       " ('play', 539),\n",
       " ('singing', 540),\n",
       " ('hikers', 541),\n",
       " ('climb', 542),\n",
       " ('snow-covered', 543),\n",
       " ('winter', 544),\n",
       " ('clutter', 545),\n",
       " ('blocks', 546),\n",
       " ('antique', 547),\n",
       " ('leaving', 548),\n",
       " ('reflection', 549),\n",
       " ('guys', 550),\n",
       " ('kid', 551),\n",
       " ('spa', 552),\n",
       " ('like', 553),\n",
       " ('shown', 554),\n",
       " ('only', 555),\n",
       " ('scissors', 556),\n",
       " ('loaded', 557),\n",
       " ('end', 558),\n",
       " ('orange', 559),\n",
       " ('gray', 560),\n",
       " ('accents', 561),\n",
       " ('door', 562),\n",
       " ('behind', 563),\n",
       " ('corner', 564),\n",
       " ('bricks', 565),\n",
       " ('lining', 566),\n",
       " ('teddy', 567),\n",
       " ('dimly', 568),\n",
       " ('lying', 569),\n",
       " ('bedspread', 570),\n",
       " ('mattress', 571),\n",
       " ('ocean', 572),\n",
       " ('loving', 573),\n",
       " ('pose', 574),\n",
       " ('cake', 575),\n",
       " ('biker', 576),\n",
       " ('stands', 577),\n",
       " ('legs', 578),\n",
       " ('stone', 579),\n",
       " ('focus', 580),\n",
       " ('shirtless', 581),\n",
       " ('pink', 582),\n",
       " ('drinking', 583),\n",
       " ('dark', 584),\n",
       " ('profile', 585),\n",
       " ('before', 586),\n",
       " ('tops', 587),\n",
       " ('individual', 588),\n",
       " ('covers', 589),\n",
       " ('himself', 590),\n",
       " ('rainy', 591),\n",
       " ('day', 592),\n",
       " ('cleaning', 593),\n",
       " ('products', 594),\n",
       " ('four', 595),\n",
       " ('lawn', 596),\n",
       " ('females', 597),\n",
       " ('ready', 598),\n",
       " ('skate', 599),\n",
       " ('cement', 600),\n",
       " ('seating', 601),\n",
       " ('basket', 602),\n",
       " ('yellow', 603),\n",
       " ('keyboard', 604),\n",
       " ('having', 605),\n",
       " ('slice', 606),\n",
       " ('bread', 607),\n",
       " ('jelly', 608),\n",
       " ('crossing', 609),\n",
       " ('placed', 610),\n",
       " ('passenger', 611),\n",
       " ('same', 612),\n",
       " ('chairs', 613),\n",
       " ('cupboards', 614),\n",
       " ('sandy', 615),\n",
       " ('mid', 616),\n",
       " ('sized', 617),\n",
       " ('leaning', 618),\n",
       " ('forward', 619),\n",
       " ('equipped', 620),\n",
       " ('support', 621),\n",
       " ('bars', 622),\n",
       " ('disabled', 623),\n",
       " ('television', 624),\n",
       " ('reflected', 625),\n",
       " ('off', 626),\n",
       " ('nap', 627),\n",
       " ('lays', 628),\n",
       " ('chest', 629),\n",
       " ('attached', 630),\n",
       " ('version', 631),\n",
       " ('personal', 632),\n",
       " ('dual', 633),\n",
       " ('wrap', 634),\n",
       " ('shadow', 635),\n",
       " ('un', 636),\n",
       " ('occupied', 637),\n",
       " ('allover', 638),\n",
       " ('tiling', 639),\n",
       " ('wig', 640),\n",
       " ('shopping', 641),\n",
       " ('center', 642),\n",
       " ('containing', 643),\n",
       " ('step', 644),\n",
       " ('close', 645),\n",
       " ('curtain', 646),\n",
       " ('he', 647),\n",
       " ('falls', 648),\n",
       " ('asleep', 649),\n",
       " ('flat', 650),\n",
       " ('screen', 651),\n",
       " ('box', 652),\n",
       " ('tissues', 653),\n",
       " ('remote', 654),\n",
       " ('control', 655),\n",
       " ('nearly', 656),\n",
       " ('pets', 657),\n",
       " ('college', 658),\n",
       " ('campus', 659),\n",
       " ('splash', 660),\n",
       " ('added', 661),\n",
       " ('cleaned', 662),\n",
       " ('air', 663),\n",
       " ('just', 664),\n",
       " ('construction', 665),\n",
       " ('strip', 666),\n",
       " ('single', 667),\n",
       " ('teenage', 668),\n",
       " ('wire', 669),\n",
       " ('against', 670),\n",
       " ('surrounded', 671),\n",
       " ('handrails', 672),\n",
       " ('cards', 673),\n",
       " ('parade', 674),\n",
       " ('win', 675),\n",
       " ('industrial', 676),\n",
       " ('ovens', 677),\n",
       " ('pictured', 678),\n",
       " ('bowl', 679),\n",
       " ('separate', 680),\n",
       " ('showing', 681),\n",
       " ('inspecting', 682),\n",
       " ('project', 683),\n",
       " ('banquet', 684),\n",
       " ('tables', 685),\n",
       " ('held', 686),\n",
       " ('variety', 687),\n",
       " ('meats', 688),\n",
       " ('dips', 689),\n",
       " ('pastries', 690),\n",
       " ('plaza', 691),\n",
       " ('stores', 692),\n",
       " ('sedan', 693),\n",
       " ('cloudy', 694),\n",
       " ('microphones', 695),\n",
       " ('ages', 696),\n",
       " ('skiing', 697),\n",
       " ('slope', 698),\n",
       " ('gathering', 699),\n",
       " ('lighted', 700),\n",
       " ('something', 701),\n",
       " ('groceries', 702),\n",
       " ('race', 703),\n",
       " ('busy', 704),\n",
       " ('athletes', 705),\n",
       " ('appear', 706),\n",
       " ('lots', 707),\n",
       " ('space', 708),\n",
       " ('spiral', 709),\n",
       " ('hanging', 710),\n",
       " ('chihuahua', 711),\n",
       " ('attractive', 712),\n",
       " ('couch', 713),\n",
       " ('looks', 714),\n",
       " ('them', 715),\n",
       " ('older', 716),\n",
       " ('getting', 717),\n",
       " ('lookers', 718),\n",
       " ('refridgerator', 719),\n",
       " ('friends', 720),\n",
       " ('enjoy', 721),\n",
       " ('grassy', 722),\n",
       " ('fenced', 723),\n",
       " ('hooked', 724),\n",
       " ('checking', 725),\n",
       " ('holds', 726),\n",
       " ('leash', 727),\n",
       " ('fridge', 728),\n",
       " ('halfway', 729),\n",
       " ('during', 730),\n",
       " ('old-fashioned', 731),\n",
       " ('biking', 732),\n",
       " ('storefront', 733),\n",
       " ('sister', 734),\n",
       " ('trying', 735),\n",
       " ('high', 736),\n",
       " ('items', 737),\n",
       " ('shopper', 738),\n",
       " ('downtown', 739),\n",
       " ('mall', 740),\n",
       " ('kids', 741),\n",
       " ('master', 742),\n",
       " ('bedroom', 743),\n",
       " ('oddly', 744),\n",
       " ('shaped', 745),\n",
       " ('wires', 746),\n",
       " ('poles', 747),\n",
       " ('hall', 748),\n",
       " ('opening', 749),\n",
       " ('rooms', 750),\n",
       " ('nicely', 751),\n",
       " ('metallic', 752),\n",
       " ('skateboard', 753),\n",
       " ('doing', 754),\n",
       " ('technology', 755),\n",
       " ('spread', 756),\n",
       " ('spaniel', 757),\n",
       " ('leans', 758),\n",
       " ('subway', 759),\n",
       " ('court', 760),\n",
       " ('below', 761),\n",
       " ('flowers', 762),\n",
       " ('hits', 763),\n",
       " ('big', 764),\n",
       " ('spending', 765),\n",
       " ('watching', 766),\n",
       " ('park', 767),\n",
       " ('flowering', 768),\n",
       " ('tree', 769),\n",
       " ('nearby', 770),\n",
       " ('were', 771),\n",
       " ('captured', 772),\n",
       " ('altered', 773),\n",
       " ('serving', 774),\n",
       " ('quiet', 775),\n",
       " ('adults', 776),\n",
       " ('meal', 777),\n",
       " ('hallway', 778),\n",
       " ('shirt', 779),\n",
       " ('jeans', 780),\n",
       " ('use', 781),\n",
       " ('professional', 782),\n",
       " ('laptop', 783),\n",
       " ('or', 784),\n",
       " ('kind', 785),\n",
       " ('spice', 786),\n",
       " ('crosswalk', 787),\n",
       " ('bags', 788),\n",
       " ('hands', 789),\n",
       " ('spacious', 790),\n",
       " ('cross', 791),\n",
       " ('intersection', 792),\n",
       " ('skateboarding', 793),\n",
       " ('cooking', 794),\n",
       " ('paneled', 795),\n",
       " ('reflecting', 796),\n",
       " ('opposite', 797),\n",
       " ('lcd', 798),\n",
       " ('panel', 799),\n",
       " ('pad', 800),\n",
       " ('pretty', 801),\n",
       " ('spotless', 802),\n",
       " ('bidet', 803),\n",
       " ('beautiful', 804),\n",
       " ('blonde', 805),\n",
       " ('multicolored', 806),\n",
       " ('kiosk', 807),\n",
       " ('cyclists', 808),\n",
       " ('asphalt', 809),\n",
       " ('porcelain', 810),\n",
       " ('waking', 811),\n",
       " ('coat', 812),\n",
       " ('wireless', 813),\n",
       " ('role', 814),\n",
       " ('games', 815),\n",
       " ('hat', 816),\n",
       " ('traveling', 817),\n",
       " ('plate', 818),\n",
       " ('armor', 819),\n",
       " ('helmet', 820),\n",
       " ('reflective', 821),\n",
       " ('marble', 822),\n",
       " ('rust', 823),\n",
       " ('filthy', 824),\n",
       " ('alley', 825),\n",
       " ('hard', 826),\n",
       " ('waits', 827),\n",
       " ('frilly', 828),\n",
       " ('ramp', 829),\n",
       " ('asian', 830),\n",
       " ('lounge', 831),\n",
       " ('baskets', 832),\n",
       " ('goods', 833),\n",
       " ('floors', 834),\n",
       " ('gentleman', 835),\n",
       " ('alongside', 836),\n",
       " ('storage', 837),\n",
       " ('skateboarder', 838),\n",
       " ('airborne', 839),\n",
       " ('banana', 840),\n",
       " ('if', 841),\n",
       " ('telephone', 842),\n",
       " ('receiver', 843),\n",
       " ('bicyclists', 844),\n",
       " ('underneath', 845),\n",
       " ('drying', 846),\n",
       " ('modified', 847),\n",
       " ('read', 848),\n",
       " ('dress', 849),\n",
       " ('brushing', 850),\n",
       " ('teeth', 851),\n",
       " ('highly', 852),\n",
       " ('displaying', 853),\n",
       " ('train', 854),\n",
       " ('station', 855),\n",
       " ('made', 856),\n",
       " ('living', 857),\n",
       " ('toothbrush', 858),\n",
       " ('leading', 859),\n",
       " ('where', 860),\n",
       " ('tires', 861),\n",
       " ('examines', 862),\n",
       " ('surfers', 863),\n",
       " ('ride', 864),\n",
       " ('ferry', 865),\n",
       " ('vespas', 866),\n",
       " ('books', 867),\n",
       " ('chair', 868),\n",
       " ('store', 869),\n",
       " ('doll', 870),\n",
       " ('cup', 871),\n",
       " ('coffee', 872),\n",
       " ('brushes', 873),\n",
       " ('bikers', 874),\n",
       " ('turn', 875),\n",
       " ('fountain', 876),\n",
       " ('town', 877),\n",
       " ('bicyclist', 878),\n",
       " ('wait', 879),\n",
       " ('shines', 880),\n",
       " ('keys', 881),\n",
       " ('lettering', 882),\n",
       " ('competing', 883),\n",
       " ('handicap', 884),\n",
       " ('bar', 885),\n",
       " ('natural', 886),\n",
       " ('fronted', 887),\n",
       " ('combo', 888),\n",
       " ('passing', 889),\n",
       " ('long', 890),\n",
       " ('staring', 891),\n",
       " ('facing', 892),\n",
       " ('knight', 893),\n",
       " ('costume', 894),\n",
       " ('motorcycle', 895),\n",
       " ('driving', 896),\n",
       " ('stack', 897),\n",
       " ('beverages', 898),\n",
       " ('standup', 899),\n",
       " ('male', 900),\n",
       " ('dump', 901),\n",
       " ('truck', 902),\n",
       " ('commercial', 903),\n",
       " ('mirrors', 904),\n",
       " ('toothbrushes', 905),\n",
       " ('pole', 906),\n",
       " ('power', 907),\n",
       " ('lines', 908),\n",
       " ('seats', 909),\n",
       " ('blow', 910),\n",
       " ('candle', 911),\n",
       " ('birthday', 912),\n",
       " ('besides', 913),\n",
       " ('soccer', 914),\n",
       " ('fan', 915),\n",
       " ('dressing', 916),\n",
       " ('japanese', 917),\n",
       " ('displayed', 918),\n",
       " ('married', 919),\n",
       " ('posing', 920),\n",
       " ('piece', 921),\n",
       " ('performing', 922),\n",
       " ('passes', 923),\n",
       " ('shinning', 924),\n",
       " ('bright', 925),\n",
       " ('entryway', 926),\n",
       " ('tricks', 927),\n",
       " ('tan', 928),\n",
       " ('jacuzzi', 929),\n",
       " ('sweater', 930),\n",
       " ('inspired', 931),\n",
       " ('alone', 932),\n",
       " ('locked', 933),\n",
       " ('meter', 934),\n",
       " ('catches', 935),\n",
       " ('but', 936),\n",
       " ('fall', 937),\n",
       " ('stopped', 938),\n",
       " ('downed', 939),\n",
       " ('drink', 940),\n",
       " ('outfit', 941),\n",
       " ('cutout', 942),\n",
       " ('sheer', 943),\n",
       " ('curtains', 944),\n",
       " ('skiis', 945),\n",
       " ('tissue', 946),\n",
       " ('dispenser', 947),\n",
       " ('unused', 948),\n",
       " ('2', 949),\n",
       " ('ceramic', 950),\n",
       " ('dinner', 951),\n",
       " ('tiny', 952),\n",
       " ('little', 953),\n",
       " ('reaching', 954),\n",
       " ('drawer', 955),\n",
       " ('arranged', 956),\n",
       " ('display', 957),\n",
       " ('decoratively', 958),\n",
       " ('resting', 959),\n",
       " ('matching', 960),\n",
       " ('bathing', 961),\n",
       " ('hot', 962),\n",
       " ('touches', 963),\n",
       " ('royal', 964),\n",
       " ('refrigerators', 965),\n",
       " ('workstation', 966),\n",
       " ('indicate', 967),\n",
       " ('have', 968),\n",
       " ('gold', 969),\n",
       " ('rectangular', 970),\n",
       " ('putting', 971),\n",
       " ('away', 972),\n",
       " ('after', 973),\n",
       " ('curtained', 974),\n",
       " ('writing', 975),\n",
       " ('pretending', 976),\n",
       " ('talk', 977),\n",
       " ('though', 978),\n",
       " ('sports', 979),\n",
       " ('going', 980),\n",
       " ('smiling', 981),\n",
       " ('stucco', 982),\n",
       " ('planks', 983),\n",
       " ('celebrating', 984),\n",
       " ('special', 985),\n",
       " ('occasion', 986),\n",
       " ('pressed', 987),\n",
       " ('lips', 988),\n",
       " ('container', 989),\n",
       " ('color', 990),\n",
       " ('fresh', 991),\n",
       " ('airy', 992),\n",
       " ('paws', 993),\n",
       " ('overexposed', 994),\n",
       " ('apartment', 995),\n",
       " ('sparse', 996),\n",
       " ('furniture', 997),\n",
       " ('moving', 998),\n",
       " ('boxes', 999),\n",
       " ...]"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#vr\n",
    "list(data_loader.dataset.vocab.word2idx.items())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'<start>': 0,\n",
       " '<end>': 1,\n",
       " '<unk>': 2,\n",
       " 'a': 3,\n",
       " 'very': 4,\n",
       " 'clean': 5,\n",
       " 'and': 6,\n",
       " 'well': 7,\n",
       " 'decorated': 8,\n",
       " 'empty': 9}"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Preview the word2idx dictionary.\n",
    "dict(list(data_loader.dataset.vocab.word2idx.items())[:10])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We also print the total number of keys."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Total number of tokens in vocabulary: 8855\n"
     ]
    }
   ],
   "source": [
    "# Print the total number of keys in the word2idx dictionary.\n",
    "print('Total number of tokens in vocabulary:', len(data_loader.dataset.vocab))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As you will see if you examine the code in **vocabulary.py**, the `word2idx` dictionary is created by looping over the captions in the training dataset.  If a token appears no less than `vocab_threshold` times in the training set, then it is added as a key to the dictionary and assigned a corresponding unique integer.  You will have the option later to amend the `vocab_threshold` argument when instantiating your data loader.  Note that in general, **smaller** values for `vocab_threshold` yield a **larger** number of tokens in the vocabulary.  You are encouraged to check this for yourself in the next code cell by decreasing the value of `vocab_threshold` before creating a new data loader.  "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "loading annotations into memory...\n",
      "Done (t=0.88s)\n",
      "creating index...\n",
      "index created!\n",
      "[0/414113] Tokenizing captions...\n",
      "[100000/414113] Tokenizing captions...\n",
      "[200000/414113] Tokenizing captions...\n",
      "[300000/414113] Tokenizing captions...\n",
      "[400000/414113] Tokenizing captions...\n",
      "loading annotations into memory...\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "  0%|          | 858/414113 [00:00<01:38, 4197.05it/s]"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Done (t=0.87s)\n",
      "creating index...\n",
      "index created!\n",
      "Obtaining caption lengths...\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "100%|██████████| 414113/414113 [01:31<00:00, 4519.93it/s]\n"
     ]
    }
   ],
   "source": [
    "# Modify the minimum word count threshold.\n",
    "vocab_threshold = 4\n",
    "\n",
    "# Obtain the data loader.\n",
    "data_loader = get_loader(transform=transform_train,\n",
    "                         mode='train',\n",
    "                         batch_size=batch_size,\n",
    "                         vocab_threshold=vocab_threshold,\n",
    "                         vocab_from_file=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Total number of tokens in vocabulary: 9955\n"
     ]
    }
   ],
   "source": [
    "# Print the total number of keys in the word2idx dictionary.\n",
    "print('Total number of tokens in vocabulary:', len(data_loader.dataset.vocab))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "There are also a few special keys in the `word2idx` dictionary.  You are already familiar with the special start word (`\"<start>\"`) and special end word (`\"<end>\"`).  There is one more special token, corresponding to unknown words (`\"<unk>\"`).  All tokens that don't appear anywhere in the `word2idx` dictionary are considered unknown words.  In the pre-processing step, any unknown tokens are mapped to the integer `2`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Special unknown word: <unk>\n",
      "All unknown words are mapped to this integer: 2\n"
     ]
    }
   ],
   "source": [
    "unk_word = data_loader.dataset.vocab.unk_word\n",
    "print('Special unknown word:', unk_word)\n",
    "\n",
    "print('All unknown words are mapped to this integer:', data_loader.dataset.vocab(unk_word))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Check this for yourself below, by pre-processing the provided nonsense words that never appear in the training captions. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "2\n",
      "2\n"
     ]
    }
   ],
   "source": [
    "print(data_loader.dataset.vocab('jfkafejw'))\n",
    "print(data_loader.dataset.vocab('ieowoqjf'))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The final thing to mention is the `vocab_from_file` argument that is supplied when creating a data loader.  To understand this argument, note that when you create a new data loader, the vocabulary (`data_loader.dataset.vocab`) is saved as a [pickle](https://docs.python.org/3/library/pickle.html) file in the project folder, with filename `vocab.pkl`.\n",
    "\n",
    "If you are still tweaking the value of the `vocab_threshold` argument, you **must** set `vocab_from_file=False` to have your changes take effect.  \n",
    "\n",
    "But once you are happy with the value that you have chosen for the `vocab_threshold` argument, you need only run the data loader *one more time* with your chosen `vocab_threshold` to save the new vocabulary to file.  Then, you can henceforth set `vocab_from_file=True` to load the vocabulary from file and speed the instantiation of the data loader.  Note that building the vocabulary from scratch is the most time-consuming part of instantiating the data loader, and so you are strongly encouraged to set `vocab_from_file=True` as soon as you are able.\n",
    "\n",
    "Note that if `vocab_from_file=True`, then any supplied argument for `vocab_threshold` when instantiating the data loader is completely ignored."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Vocabulary successfully loaded from vocab.pkl file!\n",
      "loading annotations into memory...\n",
      "Done (t=0.86s)\n",
      "creating index...\n",
      "index created!\n",
      "Obtaining caption lengths...\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "100%|██████████| 414113/414113 [01:31<00:00, 4522.14it/s]\n"
     ]
    }
   ],
   "source": [
    "# Obtain the data loader (from file). Note that it runs much faster than before!\n",
    "data_loader = get_loader(transform=transform_train,\n",
    "                         mode='train',\n",
    "                         batch_size=batch_size,\n",
    "                         vocab_from_file=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the next section, you will learn how to use the data loader to obtain batches of training data."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id='step2'></a>\n",
    "## Step 2: Use the Data Loader to Obtain Batches\n",
    "\n",
    "The captions in the dataset vary greatly in length.  You can see this by examining `data_loader.dataset.caption_lengths`, a Python list with one entry for each training caption (where the value stores the length of the corresponding caption).  \n",
    "\n",
    "In the code cell below, we use this list to print the total number of captions in the training data with each length.  As you will see below, the majority of captions have length 10.  Likewise, very short and very long captions are quite rare.  "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "value: 10 --- count: 86334\n",
      "value: 11 --- count: 79948\n",
      "value:  9 --- count: 71934\n",
      "value: 12 --- count: 57637\n",
      "value: 13 --- count: 37645\n",
      "value: 14 --- count: 22335\n",
      "value:  8 --- count: 20771\n",
      "value: 15 --- count: 12841\n",
      "value: 16 --- count:  7729\n",
      "value: 17 --- count:  4842\n",
      "value: 18 --- count:  3104\n",
      "value: 19 --- count:  2014\n",
      "value:  7 --- count:  1597\n",
      "value: 20 --- count:  1451\n",
      "value: 21 --- count:   999\n",
      "value: 22 --- count:   683\n",
      "value: 23 --- count:   534\n",
      "value: 24 --- count:   383\n",
      "value: 25 --- count:   277\n",
      "value: 26 --- count:   215\n",
      "value: 27 --- count:   159\n",
      "value: 28 --- count:   115\n",
      "value: 29 --- count:    86\n",
      "value: 30 --- count:    58\n",
      "value: 31 --- count:    49\n",
      "value: 32 --- count:    44\n",
      "value: 34 --- count:    39\n",
      "value: 37 --- count:    32\n",
      "value: 33 --- count:    31\n",
      "value: 35 --- count:    31\n",
      "value: 36 --- count:    26\n",
      "value: 38 --- count:    18\n",
      "value: 39 --- count:    18\n",
      "value: 43 --- count:    16\n",
      "value: 44 --- count:    16\n",
      "value: 48 --- count:    12\n",
      "value: 45 --- count:    11\n",
      "value: 42 --- count:    10\n",
      "value: 40 --- count:     9\n",
      "value: 49 --- count:     9\n",
      "value: 46 --- count:     9\n",
      "value: 47 --- count:     7\n",
      "value: 50 --- count:     6\n",
      "value: 51 --- count:     6\n",
      "value: 41 --- count:     6\n",
      "value: 52 --- count:     5\n",
      "value: 54 --- count:     3\n",
      "value: 56 --- count:     2\n",
      "value:  6 --- count:     2\n",
      "value: 53 --- count:     2\n",
      "value: 55 --- count:     2\n",
      "value: 57 --- count:     1\n"
     ]
    }
   ],
   "source": [
    "from collections import Counter\n",
    "\n",
    "# Tally the total number of training captions with each length.\n",
    "counter = Counter(data_loader.dataset.caption_lengths)\n",
    "lengths = sorted(counter.items(), key=lambda pair: pair[1], reverse=True)\n",
    "for value, count in lengths:\n",
    "    print('value: %2d --- count: %5d' % (value, count))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To generate batches of training data, we begin by first sampling a caption length (where the probability that any length is drawn is proportional to the number of captions with that length in the dataset).  Then, we retrieve a batch of size `batch_size` of image-caption pairs, where all captions have the sampled length.  This approach for assembling batches matches the procedure in [this paper](https://arxiv.org/pdf/1502.03044.pdf) and has been shown to be computationally efficient without degrading performance.\n",
    "\n",
    "Run the code cell below to generate a batch.  The `get_train_indices` method in the `CoCoDataset` class first samples a caption length, and then samples `batch_size` indices corresponding to training data points with captions of that length.  These indices are stored below in `indices`.\n",
    "\n",
    "These indices are supplied to the data loader, which then is used to retrieve the corresponding data points.  The pre-processed images and captions in the batch are stored in `images` and `captions`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "sampled indices: [88009, 349616, 102159, 32888, 21739, 123090, 247740, 378439, 225246, 373031]\n",
      "images.shape: torch.Size([10, 3, 224, 224])\n",
      "captions.shape: torch.Size([10, 12])\n",
      "images: tensor([[[[ 1.3755,  1.3755,  1.3755,  ...,  1.2728,  1.2728,  1.2557],\n",
      "          [ 1.3755,  1.3755,  1.3755,  ...,  1.2899,  1.2728,  1.2557],\n",
      "          [ 1.3755,  1.3584,  1.3755,  ...,  1.2557,  1.2557,  1.2557],\n",
      "          ...,\n",
      "          [ 1.4440,  1.4098,  1.4440,  ...,  1.5297,  1.5297,  1.5297],\n",
      "          [ 1.4612,  1.4440,  1.4440,  ...,  1.5639,  1.5639,  1.5468],\n",
      "          [ 1.4440,  1.4440,  1.4612,  ...,  1.5468,  1.5468,  1.5639]],\n",
      "\n",
      "         [[ 1.4307,  1.4307,  1.4307,  ...,  1.3256,  1.3081,  1.3256],\n",
      "          [ 1.4307,  1.4307,  1.4307,  ...,  1.3256,  1.3081,  1.2906],\n",
      "          [ 1.4307,  1.4132,  1.4132,  ...,  1.3081,  1.2906,  1.2906],\n",
      "          ...,\n",
      "          [ 1.3957,  1.3782,  1.4132,  ...,  1.5007,  1.5007,  1.5007],\n",
      "          [ 1.3957,  1.3782,  1.4132,  ...,  1.5182,  1.5357,  1.5182],\n",
      "          [ 1.3782,  1.3957,  1.4307,  ...,  1.4832,  1.4832,  1.5007]],\n",
      "\n",
      "         [[ 1.4374,  1.4025,  1.4025,  ...,  1.4025,  1.3851,  1.4025],\n",
      "          [ 1.4374,  1.4374,  1.4374,  ...,  1.4025,  1.3851,  1.3851],\n",
      "          [ 1.4374,  1.4200,  1.4548,  ...,  1.3851,  1.3677,  1.3851],\n",
      "          ...,\n",
      "          [ 1.3328,  1.2805,  1.3154,  ...,  1.4025,  1.4025,  1.4025],\n",
      "          [ 1.3328,  1.3154,  1.3328,  ...,  1.4200,  1.4374,  1.4200],\n",
      "          [ 1.3154,  1.3328,  1.3328,  ...,  1.4025,  1.4025,  1.4200]]],\n",
      "\n",
      "\n",
      "        [[[-1.2445, -1.2617, -1.2788,  ..., -1.2103, -1.2445, -1.2274],\n",
      "          [-1.2445, -1.2274, -1.2617,  ..., -1.2103, -1.1932, -1.1760],\n",
      "          [-1.2103, -1.1932, -1.2103,  ..., -1.2103, -1.1760, -1.1418],\n",
      "          ...,\n",
      "          [-1.9638, -1.9295, -1.9467,  ..., -0.9877, -0.9705, -0.9363],\n",
      "          [-1.9809, -1.9467, -1.9638,  ..., -0.9705, -0.9877, -0.9534],\n",
      "          [-1.9295, -1.9467, -1.9124,  ..., -0.9705, -0.9705, -0.9705]],\n",
      "\n",
      "         [[-0.8803, -0.9153, -0.9678,  ..., -0.6702, -0.6527, -0.6352],\n",
      "          [-0.8803, -0.8627, -0.9153,  ..., -0.6527, -0.6352, -0.6176],\n",
      "          [-0.8452, -0.8277, -0.8452,  ..., -0.6352, -0.6352, -0.6352],\n",
      "          ...,\n",
      "          [-1.8606, -1.8606, -1.8606,  ..., -0.1800, -0.2150, -0.1800],\n",
      "          [-1.8606, -1.8606, -1.8606,  ..., -0.1450, -0.1800, -0.1800],\n",
      "          [-1.8431, -1.8606, -1.8256,  ..., -0.1625, -0.1625, -0.1625]],\n",
      "\n",
      "         [[-0.0790, -0.0964, -0.1312,  ...,  0.3916,  0.3916,  0.3916],\n",
      "          [-0.0790, -0.0615, -0.0964,  ...,  0.3916,  0.4091,  0.4265],\n",
      "          [-0.0441, -0.0267, -0.0441,  ...,  0.4091,  0.4265,  0.4265],\n",
      "          ...,\n",
      "          [-1.5081, -1.5256, -1.5430,  ...,  0.9494,  0.9319,  0.9668],\n",
      "          [-1.5081, -1.5256, -1.5430,  ...,  0.9842,  0.9494,  0.9668],\n",
      "          [-1.5081, -1.5256, -1.5081,  ...,  0.9668,  0.9842,  0.9668]]],\n",
      "\n",
      "\n",
      "        [[[-0.1143,  0.1083,  0.0227,  ..., -0.3198, -0.5424, -0.6965],\n",
      "          [-0.1828, -0.0801,  0.0227,  ..., -0.2513, -0.4911, -0.6281],\n",
      "          [-0.3369, -0.1999, -0.2342,  ..., -0.1314, -0.2684, -0.4226],\n",
      "          ...,\n",
      "          [-0.3198, -0.3027, -0.3541,  ...,  1.2214,  1.2385,  1.2557],\n",
      "          [-0.1486, -0.0801, -0.1314,  ...,  1.4440,  1.4612,  1.4269],\n",
      "          [-0.0116,  0.0227, -0.0287,  ...,  1.7865,  1.7523,  1.7352]],\n",
      "\n",
      "         [[-0.2675, -0.0924, -0.1625,  ..., -0.1800, -0.3901, -0.6001],\n",
      "          [-0.3200, -0.3025, -0.2500,  ..., -0.0924, -0.3200, -0.4951],\n",
      "          [-0.4426, -0.3901, -0.4601,  ..., -0.0049, -0.1099, -0.3025],\n",
      "          ...,\n",
      "          [-0.2850, -0.3025, -0.3550,  ...,  1.4482,  1.4307,  1.4307],\n",
      "          [-0.1275, -0.1625, -0.1975,  ...,  1.6232,  1.6408,  1.5882],\n",
      "          [-0.0224, -0.0224, -0.0574,  ...,  1.8859,  1.8859,  1.8683]],\n",
      "\n",
      "         [[-0.8284, -0.5844, -0.8458,  ..., -0.3055, -0.5147, -0.5844],\n",
      "          [-0.8458, -0.7587, -0.7936,  ..., -0.0964, -0.4624, -0.6193],\n",
      "          [-0.9156, -0.8633, -0.9330,  ...,  0.0953, -0.2184, -0.4973],\n",
      "          ...,\n",
      "          [-0.5844, -0.6018, -0.6715,  ...,  1.8034,  1.7685,  1.8034],\n",
      "          [-0.5147, -0.5147, -0.5321,  ...,  1.9254,  1.9254,  1.8905],\n",
      "          [-0.3578, -0.3578, -0.4101,  ...,  2.1520,  2.1346,  2.1520]]],\n",
      "\n",
      "\n",
      "        ...,\n",
      "\n",
      "\n",
      "        [[[ 1.3755,  1.3927,  1.3927,  ...,  1.7694,  1.7694,  1.7694],\n",
      "          [ 1.3927,  1.3755,  1.3927,  ...,  1.7694,  1.7865,  1.7694],\n",
      "          [ 1.3927,  1.3755,  1.3755,  ...,  1.7694,  1.7694,  1.7523],\n",
      "          ...,\n",
      "          [-0.9705, -0.9705, -0.9534,  ..., -1.1075, -1.0390, -0.9705],\n",
      "          [-0.9192, -0.9192, -0.9192,  ..., -1.0904, -1.0390, -0.9877],\n",
      "          [-0.9020, -0.8678, -0.8678,  ..., -1.1075, -1.0733, -1.0390]],\n",
      "\n",
      "         [[ 1.5707,  1.5707,  1.5882,  ...,  1.9559,  1.9559,  1.9559],\n",
      "          [ 1.5707,  1.5532,  1.5707,  ...,  1.9384,  1.9384,  1.9559],\n",
      "          [ 1.5532,  1.5532,  1.5532,  ...,  1.9384,  1.9209,  1.9384],\n",
      "          ...,\n",
      "          [-1.8431, -1.8256, -1.8256,  ..., -1.2479, -1.2304, -1.2129],\n",
      "          [-1.8081, -1.8081, -1.8256,  ..., -1.2829, -1.2654, -1.2304],\n",
      "          [-1.8081, -1.7906, -1.8081,  ..., -1.2829, -1.2654, -1.2654]],\n",
      "\n",
      "         [[ 1.8731,  1.8731,  1.8731,  ...,  2.2566,  2.2566,  2.2566],\n",
      "          [ 1.8731,  1.8731,  1.8731,  ...,  2.2391,  2.2566,  2.2391],\n",
      "          [ 1.8557,  1.8731,  1.8557,  ...,  2.2217,  2.2217,  2.2391],\n",
      "          ...,\n",
      "          [-1.3687, -1.3687, -1.3687,  ..., -0.5670, -0.5495, -0.5147],\n",
      "          [-1.3513, -1.3687, -1.3513,  ..., -0.5844, -0.5495, -0.5321],\n",
      "          [-1.3687, -1.3339, -1.3687,  ..., -0.5495, -0.5670, -0.5495]]],\n",
      "\n",
      "\n",
      "        [[[-1.5870, -1.6042, -1.3644,  ..., -0.9363, -0.7993, -1.1075],\n",
      "          [-1.3473, -1.5185, -1.6042,  ..., -0.7993, -0.8507, -1.3987],\n",
      "          [-1.5014, -1.5699, -1.5014,  ..., -0.7137, -0.8849, -1.3815],\n",
      "          ...,\n",
      "          [ 1.2043,  1.3242,  1.3242,  ...,  0.2453,  0.2111,  0.1939],\n",
      "          [ 0.7762,  0.7933,  0.8789,  ...,  0.0227, -0.0287,  0.0227],\n",
      "          [ 0.7419,  0.7248,  0.6563,  ...,  0.0741,  0.0741, -0.0116]],\n",
      "\n",
      "         [[-1.1954, -1.2129, -0.9328,  ..., -0.1975, -0.3025, -0.4601],\n",
      "          [-0.8627, -0.9503, -1.0028,  ..., -0.2150, -0.2675, -0.7052],\n",
      "          [-0.9503, -1.1253, -1.1253,  ..., -0.1275, -0.3725, -0.9503],\n",
      "          ...,\n",
      "          [ 1.1155,  1.2381,  1.2206,  ...,  0.2577,  0.2052,  0.1702],\n",
      "          [ 0.7304,  0.7304,  0.8004,  ...,  0.0126, -0.0224, -0.0224],\n",
      "          [ 0.7129,  0.6954,  0.5903,  ...,  0.1001,  0.1001, -0.0399]],\n",
      "\n",
      "         [[-1.3687, -1.3339, -1.0898,  ..., -0.3404, -0.2707, -0.4624],\n",
      "          [-1.1770, -1.2816, -1.1596,  ..., -0.1312, -0.4973, -0.6018],\n",
      "          [-1.1944, -1.3339, -1.2119,  ..., -0.2881, -0.8807, -1.2990],\n",
      "          ...,\n",
      "          [ 1.1411,  1.2631,  1.2108,  ...,  0.4265,  0.3916,  0.3393],\n",
      "          [ 0.7925,  0.8099,  0.8797,  ...,  0.1999,  0.1476,  0.1651],\n",
      "          [ 0.7751,  0.7576,  0.7228,  ...,  0.2348,  0.2348,  0.1302]]],\n",
      "\n",
      "\n",
      "        [[[ 1.4954,  1.4440,  1.3755,  ...,  2.1804,  2.1804,  2.1975],\n",
      "          [ 1.5125,  1.4612,  1.3927,  ...,  2.2147,  2.1975,  2.2147],\n",
      "          [ 1.5125,  1.4612,  1.4269,  ...,  2.2147,  2.2147,  2.1975],\n",
      "          ...,\n",
      "          [-1.2959, -0.6452, -0.9534,  ..., -1.3302, -1.3987, -1.4843],\n",
      "          [-1.0390, -0.7650, -1.0048,  ..., -1.3473, -1.3644, -1.0733],\n",
      "          [-0.8335, -1.1247, -1.2103,  ..., -1.3987, -1.2788, -1.3815]],\n",
      "\n",
      "         [[ 2.0959,  2.0434,  2.0084,  ...,  2.3936,  2.3936,  2.4111],\n",
      "          [ 2.0784,  2.0434,  2.0434,  ...,  2.3936,  2.3761,  2.3936],\n",
      "          [ 2.0609,  2.0259,  2.0259,  ...,  2.3410,  2.3410,  2.3585],\n",
      "          ...,\n",
      "          [-0.4951,  0.1702, -0.1450,  ..., -0.4601, -0.6176, -0.7402],\n",
      "          [-0.2500,  0.0476, -0.1800,  ..., -0.4776, -0.5651, -0.3550],\n",
      "          [-0.0399, -0.3550, -0.4251,  ..., -0.6352, -0.5476, -0.7227]],\n",
      "\n",
      "         [[ 1.9080,  1.8905,  1.8905,  ...,  1.9603,  1.9603,  1.9777],\n",
      "          [ 1.8905,  1.8731,  1.8731,  ...,  1.9777,  1.9603,  1.9777],\n",
      "          [ 1.8557,  1.8208,  1.8557,  ...,  1.9777,  1.9603,  1.9428],\n",
      "          ...,\n",
      "          [-1.2119, -0.6541, -0.9504,  ..., -0.9853, -1.0898, -1.2467],\n",
      "          [-0.9678, -0.7761, -1.0550,  ..., -1.0027, -1.0027, -0.6715],\n",
      "          [-0.7238, -0.9853, -1.0724,  ..., -1.1247, -0.9678, -0.9678]]]])\n",
      "captions: tensor([[    0,     3,   645,   294,    13,     3,    36,  1804,    21,\n",
      "             3,   840,     1],\n",
      "        [    0,     3,   330,   206,     3,   386,    77,     3,    19,\n",
      "           265,    18,     1],\n",
      "        [    0,     3,    33,    30,    77,   121,    13,     3,  1254,\n",
      "           114,    18,     1],\n",
      "        [    0,     3,    57,    77,    32,  1006,    13,     3,   234,\n",
      "           235,    18,     1],\n",
      "        [    0,    73,  1503,   613,   364,   161,    47,   239,   390,\n",
      "           214,    18,     1],\n",
      "        [    0,     3,  1610,    13,  1302,    79,   110,   523,    39,\n",
      "             3,  2620,     1],\n",
      "        [    0,     3,    59,    14,   681,   198,    86,    85,    86,\n",
      "             6,    56,     1],\n",
      "        [    0,     3,   335,  1466,  1467,  2866,   435,     3,  1121,\n",
      "           185,    18,     1],\n",
      "        [    0,     3,   169,    77,    60,   779,   360,     3,  2323,\n",
      "          4062,    18,     1],\n",
      "        [    0,  3983,   135,    77,     3,   204,    39,     3,  1379,\n",
      "           592,    18,     1]])\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "import torch.utils.data as data\n",
    "\n",
    "# Randomly sample a caption length, and sample indices with that length.\n",
    "indices = data_loader.dataset.get_train_indices()\n",
    "print('sampled indices:', indices)\n",
    "\n",
    "# Create and assign a batch sampler to retrieve a batch with the sampled indices.\n",
    "new_sampler = data.sampler.SubsetRandomSampler(indices=indices)\n",
    "data_loader.batch_sampler.sampler = new_sampler\n",
    "    \n",
    "# Obtain the batch.\n",
    "images, captions = next(iter(data_loader))\n",
    "\n",
    "\n",
    "print('images.shape:', images.shape)\n",
    "print('captions.shape:', captions.shape)\n",
    "\n",
    "# (Optional) Uncomment the lines of code below to print the pre-processed images and captions.\n",
    "print('images:', images)\n",
    "print('captions:', captions)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Each time you run the code cell above, a different caption length is sampled, and a different batch of training data is returned.  Run the code cell multiple times to check this out!\n",
    "\n",
    "You will train your model in the next notebook in this sequence (**2_Training.ipynb**). This code for generating training batches will be provided to you.\n",
    "\n",
    "> Before moving to the next notebook in the sequence (**2_Training.ipynb**), you are strongly encouraged to take the time to become very familiar with the code in  **data_loader.py** and **vocabulary.py**.  **Step 1** and **Step 2** of this notebook are designed to help facilitate a basic introduction and guide your understanding.  However, our description is not exhaustive, and it is up to you (as part of the project) to learn how to best utilize these files to complete the project.  __You should NOT amend any of the code in either *data_loader.py* or *vocabulary.py*.__\n",
    "\n",
    "In the next steps, we focus on learning how to specify a CNN-RNN architecture in PyTorch, towards the goal of image captioning."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "sampled indices: [250830, 356781, 288659, 142385, 337116, 156951, 265828, 286311, 142872, 25112]\n",
      "images.shape: torch.Size([10, 3, 224, 224])\n",
      "captions.shape: torch.Size([10, 15])\n",
      "images: tensor([[[[-0.7993, -0.7993, -0.7822,  ..., -0.5253, -0.5253, -0.4739],\n",
      "          [-0.7993, -0.7822, -0.7822,  ..., -0.5424, -0.5424, -0.5253],\n",
      "          [-0.7993, -0.7650, -0.7822,  ..., -0.5767, -0.5253, -0.5253],\n",
      "          ...,\n",
      "          [-0.3883, -0.3712, -0.4226,  ..., -0.7822, -0.7650, -0.7650],\n",
      "          [-0.5596, -0.5424, -0.5253,  ..., -0.7993, -0.8164, -0.7308],\n",
      "          [-0.5596, -0.4911, -0.4568,  ..., -0.6965, -0.7308, -0.6452]],\n",
      "\n",
      "         [[-0.6702, -0.6877, -0.6702,  ..., -0.3375, -0.3375, -0.2850],\n",
      "          [-0.6702, -0.6527, -0.6702,  ..., -0.3550, -0.3550, -0.3375],\n",
      "          [-0.6702, -0.6527, -0.6527,  ..., -0.3901, -0.3375, -0.3375],\n",
      "          ...,\n",
      "          [-0.1975, -0.1275, -0.1450,  ..., -0.6877, -0.6702, -0.6702],\n",
      "          [-0.3901, -0.3550, -0.3025,  ..., -0.6877, -0.7227, -0.6352],\n",
      "          [-0.3725, -0.3200, -0.2675,  ..., -0.5651, -0.6176, -0.5301]],\n",
      "\n",
      "         [[-0.4275, -0.4624, -0.4450,  ..., -0.0964, -0.0615, -0.0092],\n",
      "          [-0.4101, -0.4275, -0.4275,  ..., -0.0964, -0.0790, -0.0441],\n",
      "          [-0.4101, -0.3927, -0.3927,  ..., -0.1312, -0.0615, -0.0441],\n",
      "          ...,\n",
      "          [ 0.1128,  0.1651,  0.1128,  ..., -0.5321, -0.5147, -0.5147],\n",
      "          [-0.0615, -0.0267, -0.0267,  ..., -0.5321, -0.5495, -0.4624],\n",
      "          [-0.0790,  0.0082,  0.0256,  ..., -0.4101, -0.4450, -0.3578]]],\n",
      "\n",
      "\n",
      "        [[[-1.7240, -1.7069, -1.7069,  ..., -0.2342, -0.2513, -0.3027],\n",
      "          [-1.8268, -1.7240, -1.6213,  ..., -0.2856, -0.2856, -0.2684],\n",
      "          [-1.7240, -1.6898, -1.5528,  ..., -0.2684, -0.2856, -0.2856],\n",
      "          ...,\n",
      "          [-1.3987, -1.1760, -0.9020,  ..., -1.8953, -1.8953, -1.8097],\n",
      "          [-1.7925, -1.7412, -1.7240,  ..., -1.9124, -1.9467, -1.8953],\n",
      "          [-1.8268, -1.7583, -1.7583,  ..., -1.7412, -1.8268, -1.7583]],\n",
      "\n",
      "         [[-1.5980, -1.5805, -1.5805,  ..., -0.1099, -0.1625, -0.2150],\n",
      "          [-1.6506, -1.5805, -1.5105,  ..., -0.0574, -0.1099, -0.1450],\n",
      "          [-1.6331, -1.6155, -1.4755,  ..., -0.0399, -0.0574, -0.1099],\n",
      "          ...,\n",
      "          [-1.0903, -0.8627, -0.6702,  ..., -1.6155, -1.6155, -1.5805],\n",
      "          [-1.5805, -1.5455, -1.6155,  ..., -1.6681, -1.6856, -1.6506],\n",
      "          [-1.6681, -1.6331, -1.5630,  ..., -1.5980, -1.6331, -1.5105]],\n",
      "\n",
      "         [[-1.4733, -1.4210, -1.4384,  ...,  0.0431, -0.0615, -0.1661],\n",
      "          [-1.5430, -1.3861, -1.3164,  ...,  0.0605,  0.0082,  0.0082],\n",
      "          [-1.4559, -1.4210, -1.2990,  ...,  0.0779,  0.0605,  0.0779],\n",
      "          ...,\n",
      "          [-0.7238, -0.5147, -0.2532,  ..., -1.3861, -1.4210, -1.3513],\n",
      "          [-1.2990, -1.3339, -1.3861,  ..., -1.4036, -1.4384, -1.3861],\n",
      "          [-1.3687, -1.3687, -1.3513,  ..., -1.2990, -1.3339, -1.1944]]],\n",
      "\n",
      "\n",
      "        [[[-2.0837, -2.0837, -2.0837,  ..., -1.5357, -1.4672, -1.5699],\n",
      "          [-2.0837, -2.0837, -2.0837,  ..., -1.3644, -1.4329, -1.5014],\n",
      "          [-2.0837, -2.1008, -2.1008,  ..., -1.2103, -1.2445, -1.2445],\n",
      "          ...,\n",
      "          [ 0.8961,  0.9646,  0.9988,  ...,  0.1254,  0.2624,  0.4337],\n",
      "          [ 0.8447,  0.9132,  0.9646,  ...,  0.1939, -0.1999, -0.0116],\n",
      "          [ 0.9303,  0.9646,  0.9474,  ..., -0.3027, -0.4054, -0.1143]],\n",
      "\n",
      "         [[-1.9832, -1.9832, -2.0007,  ..., -1.4580, -1.3880, -1.4930],\n",
      "          [-1.9832, -1.9657, -1.9657,  ..., -1.2479, -1.3179, -1.3704],\n",
      "          [-1.9832, -1.9832, -1.9832,  ..., -1.1779, -1.1954, -1.1604],\n",
      "          ...,\n",
      "          [ 1.0455,  1.1331,  1.1506,  ..., -0.2325, -0.1275,  0.0126],\n",
      "          [ 1.0105,  1.0805,  1.1155,  ..., -0.1625, -0.6001, -0.4601],\n",
      "          [ 1.0980,  1.1331,  1.0980,  ..., -0.7052, -0.8102, -0.5651]],\n",
      "\n",
      "         [[-1.7696, -1.7870, -1.8044,  ..., -1.5430, -1.4384, -1.4559],\n",
      "          [-1.7870, -1.7870, -1.7870,  ..., -1.4210, -1.4210, -1.3861],\n",
      "          [-1.7870, -1.8044, -1.8044,  ..., -1.4210, -1.4210, -1.3164],\n",
      "          ...,\n",
      "          [ 1.1759,  1.2631,  1.3154,  ..., -0.4973, -0.4798, -0.3055],\n",
      "          [ 1.1411,  1.2108,  1.2805,  ..., -0.3578, -0.7936, -0.7238],\n",
      "          [ 1.2282,  1.2805,  1.2805,  ..., -0.8284, -1.0724, -0.8633]]],\n",
      "\n",
      "\n",
      "        ...,\n",
      "\n",
      "\n",
      "        [[[-1.6727, -1.6727, -1.6898,  ..., -1.7240, -1.7069, -1.6213],\n",
      "          [-1.7240, -1.6898, -1.6898,  ..., -1.6898, -1.6898, -1.6555],\n",
      "          [-1.6898, -1.6898, -1.6727,  ..., -1.6727, -1.6727, -1.6727],\n",
      "          ...,\n",
      "          [ 0.7419,  0.7077,  0.7419,  ...,  0.9646,  0.9817,  0.8961],\n",
      "          [ 0.8276,  0.7762,  0.6734,  ...,  0.9817,  0.9303,  0.8961],\n",
      "          [ 0.8618,  0.8447,  0.7248,  ...,  0.9646,  0.9303,  0.9646]],\n",
      "\n",
      "         [[-1.1954, -1.1078, -1.1604,  ..., -1.2654, -1.2129, -1.1604],\n",
      "          [-1.2479, -1.1078, -1.1429,  ..., -1.1779, -1.1779, -1.1604],\n",
      "          [-1.1954, -1.0728, -1.1078,  ..., -1.1604, -1.1604, -1.1429],\n",
      "          ...,\n",
      "          [ 1.1331,  1.0980,  1.1506,  ...,  1.3081,  1.3256,  1.2381],\n",
      "          [ 1.2031,  1.1856,  1.1155,  ...,  1.3431,  1.2906,  1.2556],\n",
      "          [ 1.2381,  1.2556,  1.1506,  ...,  1.3256,  1.2906,  1.3431]],\n",
      "\n",
      "         [[-1.1770, -1.1247, -1.1596,  ..., -1.2641, -1.2119, -1.1421],\n",
      "          [-1.2293, -1.1247, -1.1421,  ..., -1.2119, -1.1944, -1.1944],\n",
      "          [-1.1944, -1.1073, -1.1073,  ..., -1.1770, -1.1770, -1.1596],\n",
      "          ...,\n",
      "          [-0.3927, -0.3578, -0.2881,  ...,  0.3219,  0.3742,  0.2348],\n",
      "          [-0.2532, -0.2707, -0.3753,  ...,  0.2522,  0.2173,  0.1302],\n",
      "          [-0.0441, -0.0441, -0.2358,  ...,  0.2348,  0.1476,  0.1651]]],\n",
      "\n",
      "\n",
      "        [[[ 1.9920,  1.9749,  1.9749,  ..., -0.0287, -0.0458, -0.0801],\n",
      "          [ 1.9749,  1.9749,  1.9749,  ..., -1.4329, -1.3473, -1.4672],\n",
      "          [ 1.9749,  1.9578,  1.9749,  ..., -1.5870, -1.7240, -1.8439],\n",
      "          ...,\n",
      "          [-0.7479, -0.6965, -0.6109,  ..., -2.1179, -2.1179, -2.1179],\n",
      "          [-0.7479, -0.5938, -0.4568,  ..., -2.1179, -2.1179, -2.1179],\n",
      "          [-0.6623, -0.5596, -0.4397,  ..., -2.1179, -2.1179, -2.1179]],\n",
      "\n",
      "         [[ 2.1660,  2.1485,  2.1485,  ...,  0.1001,  0.0826,  0.0476],\n",
      "          [ 2.1485,  2.1485,  2.1485,  ..., -1.3354, -1.2479, -1.3704],\n",
      "          [ 2.1485,  2.1310,  2.1485,  ..., -1.4930, -1.6331, -1.7556],\n",
      "          ...,\n",
      "          [-0.6352, -0.5826, -0.4951,  ..., -2.0357, -2.0357, -2.0357],\n",
      "          [-0.6352, -0.4776, -0.3375,  ..., -2.0357, -2.0357, -2.0357],\n",
      "          [-0.5476, -0.4426, -0.3200,  ..., -2.0357, -2.0357, -2.0357]],\n",
      "\n",
      "         [[ 2.3786,  2.3611,  2.3611,  ...,  0.3219,  0.3045,  0.2696],\n",
      "          [ 2.3611,  2.3611,  2.3611,  ..., -1.1073, -1.0201, -1.1421],\n",
      "          [ 2.3611,  2.3437,  2.3611,  ..., -1.2641, -1.4036, -1.5256],\n",
      "          ...,\n",
      "          [-0.4101, -0.3578, -0.2707,  ..., -1.8044, -1.8044, -1.8044],\n",
      "          [-0.4101, -0.2532, -0.1138,  ..., -1.8044, -1.8044, -1.8044],\n",
      "          [-0.3230, -0.2184, -0.0964,  ..., -1.8044, -1.8044, -1.8044]]],\n",
      "\n",
      "\n",
      "        [[[ 2.0092,  2.0092,  1.9749,  ...,  2.2318,  2.2318,  2.2147],\n",
      "          [ 2.0434,  2.0263,  2.0263,  ...,  2.2318,  2.2147,  2.2147],\n",
      "          [ 2.0948,  2.0605,  2.0434,  ...,  2.2318,  2.2147,  2.2147],\n",
      "          ...,\n",
      "          [ 0.7762,  0.7933,  0.7933,  ..., -0.6623, -0.5767, -0.6452],\n",
      "          [ 0.7933,  0.7591,  0.7591,  ..., -0.6281, -0.5767, -0.6452],\n",
      "          [ 0.7591,  0.7933,  0.8276,  ..., -0.6281, -0.5767, -0.6452]],\n",
      "\n",
      "         [[ 1.5707,  1.5707,  1.5357,  ...,  2.1660,  2.1660,  2.1485],\n",
      "          [ 1.6057,  1.5882,  1.5882,  ...,  2.1660,  2.1485,  2.1485],\n",
      "          [ 1.6408,  1.6232,  1.6057,  ...,  2.1660,  2.1485,  2.1310],\n",
      "          ...,\n",
      "          [ 0.2577,  0.2577,  0.2577,  ..., -1.3004, -1.2829, -1.3354],\n",
      "          [ 0.2577,  0.2402,  0.2577,  ..., -1.2829, -1.2829, -1.3179],\n",
      "          [ 0.2577,  0.2577,  0.2752,  ..., -1.3179, -1.3004, -1.3179]],\n",
      "\n",
      "         [[ 0.6531,  0.6531,  0.6531,  ...,  1.2980,  1.2805,  1.2457],\n",
      "          [ 0.6705,  0.6705,  0.6879,  ...,  1.2805,  1.2631,  1.2631],\n",
      "          [ 0.7054,  0.7054,  0.7054,  ...,  1.2631,  1.2457,  1.2457],\n",
      "          ...,\n",
      "          [-0.6018, -0.5495, -0.4798,  ..., -1.6650, -1.6476, -1.6824],\n",
      "          [-0.5670, -0.5670, -0.5321,  ..., -1.6650, -1.6476, -1.6824],\n",
      "          [-0.5844, -0.5321, -0.5147,  ..., -1.6999, -1.6650, -1.6824]]]])\n",
      "captions: tensor([[    0,     3,   169,   139,    47,   626,    40,   599,   354,\n",
      "            77,     3,  2428,   522,    18,     1],\n",
      "        [    0,     3,    20,   818,  1168,    21,     3,   921,    13,\n",
      "          2338,  2187,  2188,  3393,    18,     1],\n",
      "        [    0,   250,   130,     3,    59,    92,   224,    39,   257,\n",
      "            13,     3,  1208,  1014,  2271,     1],\n",
      "        [    0,     3,   115,   224,    39,     3,   264,   119,  1584,\n",
      "           285,   111,    32,  1179,    18,     1],\n",
      "        [    0,     3,   169,   130,  1359,    77,    32,   514,    21,\n",
      "             3,  2302,   563,   365,    18,     1],\n",
      "        [    0,    50,   550,  3254,    39,   523,   169,    21,    32,\n",
      "           353,   730,     3,  7402,   147,     1],\n",
      "        [    0,     3,   921,    13,  1720,   130,   918,    77,   121,\n",
      "            13,     3,   209,   934,    18,     1],\n",
      "        [    0,     3,    98,    21,     3,  1481,  1558,   428,  4335,\n",
      "           101,    50,   409,    51,    18,     1],\n",
      "        [    0,     3,   169,   130,   310,    39,    32,   157,   489,\n",
      "             6,  1319,     3,     2,    18,     1],\n",
      "        [    0,     3,    10,    56,    77,     3,    10,   224,   364,\n",
      "           161,     3,    20,    57,    18,     1]])\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "import torch.utils.data as data\n",
    "\n",
    "# Randomly sample a caption length, and sample indices with that length.\n",
    "indices = data_loader.dataset.get_train_indices()\n",
    "print('sampled indices:', indices)\n",
    "\n",
    "# Create and assign a batch sampler to retrieve a batch with the sampled indices.\n",
    "new_sampler = data.sampler.SubsetRandomSampler(indices=indices)\n",
    "data_loader.batch_sampler.sampler = new_sampler\n",
    "    \n",
    "# Obtain the batch.\n",
    "images, captions = next(iter(data_loader))\n",
    "\n",
    "\n",
    "print('images.shape:', images.shape)\n",
    "print('captions.shape:', captions.shape)\n",
    "\n",
    "# (Optional) Uncomment the lines of code below to print the pre-processed images and captions.\n",
    "print('images:', images)\n",
    "print('captions:', captions)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "sampled indices: [45471, 3925, 211392, 35130, 41392, 61146, 375325, 131325, 29721, 263928]\n",
      "images.shape: torch.Size([10, 3, 224, 224])\n",
      "captions.shape: torch.Size([10, 11])\n",
      "images: tensor([[[[-1.4329, -1.3473, -1.3302,  ...,  1.0673,  1.0331,  0.8618],\n",
      "          [-1.3987, -1.3815, -1.3987,  ...,  0.8789,  0.9646,  0.9817],\n",
      "          [-1.3815, -1.3644, -1.4158,  ...,  0.7248,  0.8618,  0.9474],\n",
      "          ...,\n",
      "          [ 1.4612,  1.4783,  1.4612,  ...,  1.5639,  1.5639,  1.5639],\n",
      "          [ 1.4269,  1.4440,  1.4440,  ...,  1.5982,  1.5982,  1.5810],\n",
      "          [ 1.4269,  1.4612,  1.4783,  ...,  1.5982,  1.5810,  1.5810]],\n",
      "\n",
      "         [[-1.3004, -1.2129, -1.1954,  ...,  1.2206,  1.1856,  1.0105],\n",
      "          [-1.2654, -1.2479, -1.2654,  ...,  1.0280,  1.1155,  1.1331],\n",
      "          [-1.2479, -1.2479, -1.2829,  ...,  0.8704,  1.0105,  1.0980],\n",
      "          ...,\n",
      "          [ 1.6758,  1.6933,  1.6758,  ...,  1.7808,  1.7808,  1.7808],\n",
      "          [ 1.6583,  1.6583,  1.6583,  ...,  1.8158,  1.8158,  1.7983],\n",
      "          [ 1.6583,  1.6758,  1.6933,  ...,  1.8158,  1.7983,  1.7983]],\n",
      "\n",
      "         [[-1.0898, -1.0027, -0.9678,  ...,  1.4374,  1.4025,  1.2282],\n",
      "          [-1.0724, -1.0724, -1.0724,  ...,  1.2457,  1.3328,  1.3502],\n",
      "          [-1.0027, -1.0027, -1.0724,  ...,  1.0888,  1.2282,  1.3154],\n",
      "          ...,\n",
      "          [ 2.0474,  2.0648,  2.0474,  ...,  2.0823,  2.0823,  2.0823],\n",
      "          [ 2.0300,  2.0300,  2.0300,  ...,  2.1171,  2.1171,  2.0997],\n",
      "          [ 2.0300,  2.0474,  2.0648,  ...,  2.1171,  2.0997,  2.0997]]],\n",
      "\n",
      "\n",
      "        [[[-0.1999, -0.1999, -0.1999,  ..., -0.5082, -0.4911, -0.4739],\n",
      "          [-0.1999, -0.1999, -0.1828,  ..., -0.5253, -0.5082, -0.4739],\n",
      "          [-0.1999, -0.1828, -0.1657,  ..., -0.4911, -0.4739, -0.4911],\n",
      "          ...,\n",
      "          [-1.7412, -1.7240, -1.7240,  ..., -1.3473, -1.3815, -1.4329],\n",
      "          [-1.7412, -1.7240, -1.7240,  ..., -1.4843, -1.3987, -1.2959],\n",
      "          [-1.7069, -1.7069, -1.6898,  ..., -1.5870, -1.6555, -1.2445]],\n",
      "\n",
      "         [[ 0.6429,  0.6429,  0.6429,  ...,  0.3803,  0.3803,  0.3452],\n",
      "          [ 0.6429,  0.6429,  0.6604,  ...,  0.4153,  0.3803,  0.3627],\n",
      "          [ 0.6429,  0.6429,  0.6604,  ...,  0.4153,  0.3978,  0.3803],\n",
      "          ...,\n",
      "          [-1.6155, -1.5980, -1.5805,  ..., -1.3004, -1.3354, -1.3704],\n",
      "          [-1.6331, -1.6155, -1.5980,  ..., -1.3704, -1.2829, -1.2304],\n",
      "          [-1.5980, -1.5980, -1.5805,  ..., -1.4580, -1.5105, -1.1779]],\n",
      "\n",
      "         [[ 1.6640,  1.6640,  1.6640,  ...,  1.4200,  1.4200,  1.4200],\n",
      "          [ 1.6640,  1.6640,  1.6814,  ...,  1.4374,  1.4200,  1.4200],\n",
      "          [ 1.6640,  1.6640,  1.6814,  ...,  1.4374,  1.4374,  1.4200],\n",
      "          ...,\n",
      "          [-1.4036, -1.4210, -1.4036,  ..., -1.2293, -1.2990, -1.3861],\n",
      "          [-1.3687, -1.3687, -1.3513,  ..., -1.2641, -1.2467, -1.2641],\n",
      "          [-1.3339, -1.3339, -1.3164,  ..., -1.3339, -1.4036, -1.1596]]],\n",
      "\n",
      "\n",
      "        [[[-1.2788, -1.2959, -1.2959,  ..., -0.6794, -0.7822, -0.4226],\n",
      "          [-1.2445, -1.2274, -1.2274,  ..., -1.0904, -0.8164, -0.5938],\n",
      "          [-1.2959, -1.2788, -1.2959,  ..., -1.3644, -1.3130, -1.3644],\n",
      "          ...,\n",
      "          [ 1.5468,  1.0502,  0.9646,  ...,  0.6392, -0.0116,  0.2967],\n",
      "          [ 1.2214,  0.7933,  0.8961,  ...,  1.2043,  0.5536,  0.3823],\n",
      "          [ 0.8104,  0.9646,  0.8104,  ...,  0.5364,  0.7591,  0.1083]],\n",
      "\n",
      "         [[-0.9503, -0.9678, -0.9328,  ..., -0.0749, -0.1975,  0.0826],\n",
      "          [-0.9678, -0.9678, -0.9328,  ..., -0.5126, -0.3025, -0.1099],\n",
      "          [-0.9678, -0.9678, -0.9328,  ..., -0.7752, -0.7927, -0.8978],\n",
      "          ...,\n",
      "          [ 1.7458,  1.0805,  0.9930,  ...,  0.6779,  0.0651,  0.3803],\n",
      "          [ 1.3081,  0.8880,  0.9755,  ...,  1.2731,  0.5553,  0.4503],\n",
      "          [ 0.8880,  1.0280,  0.8704,  ...,  0.5903,  0.6429,  0.1702]],\n",
      "\n",
      "         [[-0.2881, -0.2707, -0.2707,  ...,  0.8448,  0.8274,  0.8622],\n",
      "          [-0.2707, -0.2707, -0.2707,  ...,  0.7054,  0.7402,  0.6705],\n",
      "          [-0.2707, -0.3230, -0.3230,  ...,  0.3916,  0.3568,  0.0779],\n",
      "          ...,\n",
      "          [ 1.6814,  1.0714,  1.0191,  ...,  0.7576,  0.2522,  0.4788],\n",
      "          [ 1.3502,  0.9319,  0.9842,  ...,  1.4374,  0.5834,  0.4788],\n",
      "          [ 0.9668,  1.1585,  0.8971,  ...,  0.6531,  0.6879,  0.2522]]],\n",
      "\n",
      "\n",
      "        ...,\n",
      "\n",
      "\n",
      "        [[[-1.3987, -1.2959, -1.3302,  ..., -1.3130, -1.3130, -1.5357],\n",
      "          [-1.5528, -1.4672, -1.4158,  ..., -1.3473, -1.2788, -1.5870],\n",
      "          [-1.5014, -1.3815, -1.3987,  ..., -1.4500, -1.4672, -1.6727],\n",
      "          ...,\n",
      "          [-1.9295, -1.9467, -1.9467,  ...,  0.6392,  0.5878,  0.7933],\n",
      "          [-1.9295, -1.9467, -1.9638,  ...,  0.7077,  0.5193,  0.5536],\n",
      "          [-1.9638, -1.9467, -1.9295,  ...,  0.8447,  0.5707,  0.5022]],\n",
      "\n",
      "         [[-1.3179, -1.2304, -1.2479,  ..., -1.2654, -1.3004, -1.4405],\n",
      "          [-1.4230, -1.3704, -1.3179,  ..., -1.2829, -1.2129, -1.4930],\n",
      "          [-1.3880, -1.2479, -1.2829,  ..., -1.3880, -1.4230, -1.5805],\n",
      "          ...,\n",
      "          [-1.8431, -1.8606, -1.8606,  ...,  0.7304,  0.6779,  0.8880],\n",
      "          [-1.8431, -1.8606, -1.8782,  ...,  0.8004,  0.6078,  0.6604],\n",
      "          [-1.8782, -1.8606, -1.8431,  ...,  0.9405,  0.6604,  0.5903]],\n",
      "\n",
      "         [[-1.2641, -1.2119, -1.2641,  ..., -1.2467, -1.2990, -1.3339],\n",
      "          [-1.3513, -1.3339, -1.3339,  ..., -1.2641, -1.2467, -1.4036],\n",
      "          [-1.2990, -1.2119, -1.2990,  ..., -1.2641, -1.3164, -1.4210],\n",
      "          ...,\n",
      "          [-1.6127, -1.6302, -1.6302,  ...,  0.8274,  0.7402,  0.9145],\n",
      "          [-1.6127, -1.6302, -1.6476,  ...,  0.8971,  0.7228,  0.7751],\n",
      "          [-1.6476, -1.6302, -1.6127,  ...,  1.0365,  0.7576,  0.7228]]],\n",
      "\n",
      "\n",
      "        [[[ 0.0569,  0.0569,  0.0227,  ...,  0.1768,  0.1426,  0.1597],\n",
      "          [ 0.0398,  0.0227,  0.0227,  ...,  0.1426,  0.1254,  0.1426],\n",
      "          [ 0.0569,  0.0398,  0.0398,  ...,  0.1768,  0.1597,  0.1768],\n",
      "          ...,\n",
      "          [ 0.0569, -0.0458, -0.1486,  ..., -1.4672, -1.1418, -0.1486],\n",
      "          [-0.1143, -0.1999, -0.3198,  ..., -0.4397, -0.2684, -0.2342],\n",
      "          [-0.1314, -0.1314, -0.1314,  ...,  0.4508,  0.1426, -0.0629]],\n",
      "\n",
      "         [[ 1.3431,  1.3606,  1.3431,  ...,  1.3957,  1.3957,  1.3957],\n",
      "          [ 1.3256,  1.3431,  1.3606,  ...,  1.4132,  1.3957,  1.4132],\n",
      "          [ 1.3431,  1.3431,  1.3256,  ...,  1.3957,  1.3957,  1.3957],\n",
      "          ...,\n",
      "          [-0.0049, -0.0574, -0.0749,  ..., -1.6155, -1.3529, -0.7402],\n",
      "          [-0.1275, -0.1625, -0.2850,  ..., -1.0028, -0.9153, -0.8803],\n",
      "          [-0.1099, -0.1275, -0.1275,  ..., -0.4601, -0.7752, -0.9678]],\n",
      "\n",
      "         [[ 2.6051,  2.6051,  2.6051,  ...,  2.6051,  2.6051,  2.5877],\n",
      "          [ 2.5877,  2.6051,  2.6226,  ...,  2.6051,  2.5877,  2.6051],\n",
      "          [ 2.6051,  2.6051,  2.6051,  ...,  2.6051,  2.6051,  2.6051],\n",
      "          ...,\n",
      "          [ 0.1999,  0.1476,  0.1128,  ..., -1.5256, -1.4036, -1.2293],\n",
      "          [ 0.0605,  0.0431, -0.0441,  ..., -1.3687, -1.3513, -1.2293],\n",
      "          [ 0.0605,  0.0431,  0.0431,  ..., -1.2293, -1.4210, -1.3687]]],\n",
      "\n",
      "\n",
      "        [[[ 0.8961,  1.3755,  1.4783,  ...,  1.4440,  1.5297,  1.5125],\n",
      "          [ 1.3755,  1.9407,  1.8379,  ...,  1.6324,  1.6324,  1.7180],\n",
      "          [ 1.3070,  1.8208,  1.8208,  ...,  1.2728,  1.4783,  1.1529],\n",
      "          ...,\n",
      "          [ 0.0398,  0.0398, -0.1143,  ..., -1.5014, -1.9124, -1.9638],\n",
      "          [-0.1314, -0.4911, -0.3712,  ..., -1.3130, -1.7412, -1.9809],\n",
      "          [ 0.3309,  0.3481,  0.6049,  ..., -1.0562, -1.8782, -1.9980]],\n",
      "\n",
      "         [[ 0.8179,  1.3081,  1.3606,  ...,  1.3256,  1.4307,  1.4307],\n",
      "          [ 1.2906,  1.8158,  1.6933,  ...,  1.5707,  1.5707,  1.6232],\n",
      "          [ 1.2206,  1.6933,  1.6933,  ...,  1.1856,  1.3957,  1.0455],\n",
      "          ...,\n",
      "          [ 0.1527,  0.1352, -0.0049,  ..., -1.3880, -1.8256, -1.9132],\n",
      "          [-0.0224, -0.4426, -0.3200,  ..., -1.1604, -1.5980, -1.9132],\n",
      "          [ 0.3978,  0.3803,  0.6604,  ..., -0.8803, -1.7381, -1.8957]],\n",
      "\n",
      "         [[ 1.2980,  1.7860,  1.8905,  ...,  1.9080,  1.9951,  2.1171],\n",
      "          [ 1.8208,  2.4134,  2.3088,  ...,  2.0474,  2.0300,  2.3088],\n",
      "          [ 1.7337,  2.2391,  2.2391,  ...,  1.6117,  1.8905,  1.6814],\n",
      "          ...,\n",
      "          [ 0.3916,  0.3742,  0.2348,  ..., -1.1944, -1.6824, -1.7696],\n",
      "          [ 0.2522, -0.1487, -0.0615,  ..., -0.8981, -1.4036, -1.7696],\n",
      "          [ 0.7228,  0.7228,  0.9668,  ..., -0.4973, -1.4733, -1.7347]]]])\n",
      "captions: tensor([[    0,   514,  1670,    77,   514,  1015,   139,    39,   354,\n",
      "            18,     1],\n",
      "        [    0,  5368,   435,    59,   877,    77,   792,    13,   877,\n",
      "            18,     1],\n",
      "        [    0,     3,   254,   130,   170,   101,     3,   131,   895,\n",
      "            18,     1],\n",
      "        [    0,     3,    20,    57,   398,     3,   334,    13,  4835,\n",
      "            18,     1],\n",
      "        [    0,     3,  1835,   130,   135,    39,   251,   178,   136,\n",
      "            18,     1],\n",
      "        [    0,     3,    20,   818,  1168,    21,  1504,  2209,   109,\n",
      "            18,     1],\n",
      "        [    0,     3,  2323,  1557,   130,  1342,   111,     3,   353,\n",
      "            18,     1],\n",
      "        [    0,     3,  2799,   111,    47,  3258,   304,     2,   241,\n",
      "             2,     1],\n",
      "        [    0,     3,  3643,  1467,   998,   972,    34,     3,   854,\n",
      "           855,     1],\n",
      "        [    0,   251,    51,    76,    39,     3,   132,    79,   120,\n",
      "            18,     1]])\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "import torch.utils.data as data\n",
    "\n",
    "# Randomly sample a caption length, and sample indices with that length.\n",
    "indices = data_loader.dataset.get_train_indices()\n",
    "print('sampled indices:', indices)\n",
    "\n",
    "# Create and assign a batch sampler to retrieve a batch with the sampled indices.\n",
    "new_sampler = data.sampler.SubsetRandomSampler(indices=indices)\n",
    "data_loader.batch_sampler.sampler = new_sampler\n",
    "    \n",
    "# Obtain the batch.\n",
    "images, captions = next(iter(data_loader))\n",
    "\n",
    "\n",
    "print('images.shape:', images.shape)\n",
    "print('captions.shape:', captions.shape)\n",
    "\n",
    "# (Optional) Uncomment the lines of code below to print the pre-processed images and captions.\n",
    "print('images:', images)\n",
    "print('captions:', captions)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "sampled indices: [212033, 128610, 95552, 65201, 15762, 274101, 249705, 160228, 4557, 273125]\n",
      "images.shape: torch.Size([10, 3, 224, 224])\n",
      "captions.shape: torch.Size([10, 11])\n",
      "images: tensor([[[[-1.5699, -1.5870, -1.4672,  ...,  2.0777,  2.0263,  1.9920],\n",
      "          [-1.6042, -1.5528, -1.5528,  ...,  2.0777,  2.0605,  2.0263],\n",
      "          [-1.6898, -1.6555, -1.6898,  ...,  2.0605,  2.0777,  2.0948],\n",
      "          ...,\n",
      "          [ 0.7077,  0.7933,  0.8447,  ...,  0.6563,  0.6563,  0.6563],\n",
      "          [ 0.9132,  0.9646,  0.9646,  ...,  0.8276,  0.8104,  0.7762],\n",
      "          [ 1.0159,  0.9474,  0.9646,  ...,  0.9132,  0.8618,  0.8104]],\n",
      "\n",
      "         [[-1.4230, -1.4405, -1.3354,  ...,  1.5882,  1.5357,  1.5007],\n",
      "          [-1.4230, -1.3880, -1.3880,  ...,  1.6408,  1.6057,  1.5357],\n",
      "          [-1.5105, -1.4580, -1.4930,  ...,  1.6933,  1.6758,  1.6408],\n",
      "          ...,\n",
      "          [-1.2129, -1.0728, -1.0203,  ..., -1.4405, -1.4405, -1.4405],\n",
      "          [-0.8627, -0.7052, -0.7227,  ..., -1.4230, -1.4230, -1.4405],\n",
      "          [-0.6877, -0.6527, -0.6527,  ..., -1.4405, -1.4755, -1.4930]],\n",
      "\n",
      "         [[-0.9156, -0.8981, -0.7761,  ...,  0.6705,  0.6531,  0.6182],\n",
      "          [-0.8458, -0.7587, -0.7064,  ...,  0.7402,  0.7054,  0.6531],\n",
      "          [-0.8458, -0.7413, -0.7064,  ...,  0.8622,  0.8274,  0.7925],\n",
      "          ...,\n",
      "          [-0.9853, -0.8110, -0.7413,  ..., -1.3164, -1.2990, -1.2990],\n",
      "          [-0.5844, -0.4450, -0.4624,  ..., -1.3687, -1.3687, -1.3861],\n",
      "          [-0.3578, -0.3404, -0.3404,  ..., -1.3513, -1.3861, -1.4210]]],\n",
      "\n",
      "\n",
      "        [[[ 1.2899,  1.2899,  1.2385,  ...,  1.0673,  1.0844,  1.1015],\n",
      "          [ 1.3070,  1.2899,  1.2557,  ...,  1.0502,  1.0844,  1.0844],\n",
      "          [ 1.2728,  1.2557,  1.2385,  ...,  1.0331,  1.0673,  1.0673],\n",
      "          ...,\n",
      "          [ 0.0398,  0.0227,  0.0741,  ..., -0.0629, -0.1486, -0.2171],\n",
      "          [ 0.0912,  0.0912,  0.0912,  ..., -0.0458, -0.1486, -0.2342],\n",
      "          [ 0.1083,  0.1254,  0.1597,  ..., -0.1486, -0.2513, -0.3369]],\n",
      "\n",
      "         [[ 2.0609,  2.0609,  2.0084,  ...,  1.8333,  1.8683,  1.8859],\n",
      "          [ 2.0434,  2.0609,  2.0434,  ...,  1.8333,  1.8508,  1.8333],\n",
      "          [ 2.0259,  2.0259,  2.0084,  ...,  1.8333,  1.8333,  1.8333],\n",
      "          ...,\n",
      "          [ 0.3803,  0.3452,  0.3978,  ...,  0.3452,  0.2227,  0.1176],\n",
      "          [ 0.4153,  0.3978,  0.4153,  ...,  0.2927,  0.1702,  0.0651],\n",
      "          [ 0.4153,  0.4503,  0.5028,  ...,  0.2052,  0.1001,  0.0126]],\n",
      "\n",
      "         [[ 2.6051,  2.6226,  2.5877,  ...,  2.5877,  2.5703,  2.6051],\n",
      "          [ 2.6051,  2.6226,  2.6226,  ...,  2.6051,  2.6051,  2.5877],\n",
      "          [ 2.6051,  2.6226,  2.6226,  ...,  2.5877,  2.6051,  2.6051],\n",
      "          ...,\n",
      "          [ 0.4439,  0.4091,  0.4788,  ...,  0.6879,  0.6356,  0.5136],\n",
      "          [ 0.4788,  0.4788,  0.5136,  ...,  0.6879,  0.6531,  0.4788],\n",
      "          [ 0.5485,  0.5834,  0.6182,  ...,  0.6356,  0.5659,  0.4439]]],\n",
      "\n",
      "\n",
      "        [[[ 1.2728,  1.1872,  1.0331,  ...,  1.3584,  1.3584,  1.3755],\n",
      "          [ 2.2147,  2.2147,  2.1633,  ...,  1.3584,  1.3413,  1.3584],\n",
      "          [ 2.2147,  2.1804,  2.1975,  ...,  1.3755,  1.3927,  1.3755],\n",
      "          ...,\n",
      "          [-0.5082, -0.5082, -0.4568,  ..., -0.6452, -0.9363, -1.4329],\n",
      "          [-0.4568, -0.4397, -0.5767,  ..., -1.5528, -1.4843, -1.2617],\n",
      "          [-0.4568, -0.4911, -0.5424,  ..., -1.3644, -1.2788, -1.2788]],\n",
      "\n",
      "         [[ 1.0455,  1.0280,  0.8354,  ...,  0.9930,  0.9930,  1.0105],\n",
      "          [ 2.2885,  2.3585,  2.3235,  ...,  1.0455,  1.0280,  1.0105],\n",
      "          [ 2.3936,  2.3761,  2.3936,  ...,  1.0105,  1.0105,  1.0105],\n",
      "          ...,\n",
      "          [-1.3354, -1.3704, -1.3704,  ..., -1.1779, -1.4405, -1.8431],\n",
      "          [-1.3354, -1.3704, -1.3179,  ..., -1.8782, -1.8606, -1.8081],\n",
      "          [-1.3529, -1.3354, -1.2829,  ..., -1.7031, -1.6681, -1.5980]],\n",
      "\n",
      "         [[ 0.4265,  0.3045,  0.0779,  ...,  0.1825,  0.1825,  0.1476],\n",
      "          [ 2.1868,  2.3437,  2.3263,  ...,  0.0605,  0.1128,  0.1825],\n",
      "          [ 2.4831,  2.5877,  2.5354,  ...,  0.1999,  0.2173,  0.1825],\n",
      "          ...,\n",
      "          [-1.3861, -1.4036, -1.4559,  ..., -1.2641, -1.3687, -1.5953],\n",
      "          [-1.3861, -1.4559, -1.5081,  ..., -1.6999, -1.6999, -1.5953],\n",
      "          [-1.3861, -1.5081, -1.4907,  ..., -1.4210, -1.4733, -1.4036]]],\n",
      "\n",
      "\n",
      "        ...,\n",
      "\n",
      "\n",
      "        [[[-1.7925, -1.8097, -1.7925,  ..., -1.7925, -1.7925, -1.7925],\n",
      "          [-1.7925, -1.7754, -1.8097,  ..., -1.7925, -1.7925, -1.7925],\n",
      "          [-1.7754, -1.7754, -1.7925,  ..., -1.7583, -1.7925, -1.7754],\n",
      "          ...,\n",
      "          [ 2.1633,  2.1975,  2.1804,  ...,  2.2147,  2.1804,  2.1633],\n",
      "          [ 2.1462,  2.1975,  2.1975,  ...,  2.1975,  2.1804,  2.1975],\n",
      "          [ 2.1290,  2.1290,  2.1633,  ...,  2.1975,  2.2147,  2.2147]],\n",
      "\n",
      "         [[-1.6681, -1.6856, -1.6681,  ..., -1.6681, -1.6681, -1.6681],\n",
      "          [-1.6681, -1.6506, -1.6856,  ..., -1.6681, -1.6681, -1.6681],\n",
      "          [-1.6506, -1.6506, -1.6681,  ..., -1.6856, -1.6681, -1.6506],\n",
      "          ...,\n",
      "          [ 1.2556,  1.2731,  1.2731,  ...,  2.1835,  2.1835,  2.1835],\n",
      "          [ 0.9230,  0.9930,  1.0455,  ...,  2.2360,  2.2535,  2.2535],\n",
      "          [ 1.0280,  0.9930,  1.0805,  ...,  2.2710,  2.2885,  2.2710]],\n",
      "\n",
      "         [[-1.2119, -1.2293, -1.2119,  ..., -1.2119, -1.2119, -1.2119],\n",
      "          [-1.2119, -1.1944, -1.2293,  ..., -1.2119, -1.2119, -1.2119],\n",
      "          [-1.1944, -1.1944, -1.2119,  ..., -1.2119, -1.2119, -1.1944],\n",
      "          ...,\n",
      "          [ 0.7054,  0.7054,  0.7054,  ...,  2.1171,  2.1171,  2.1171],\n",
      "          [ 0.4265,  0.4614,  0.5136,  ...,  2.1346,  2.1520,  2.1520],\n",
      "          [ 0.5136,  0.4788,  0.5485,  ...,  2.1868,  2.1868,  2.1694]]],\n",
      "\n",
      "\n",
      "        [[[-0.1143, -0.1999, -0.3883,  ..., -1.0562, -0.9192, -1.0390],\n",
      "          [-0.5767, -0.5253, -0.2856,  ..., -1.0390, -0.8335, -0.8849],\n",
      "          [-0.7993, -0.7822, -0.6623,  ..., -0.9020, -0.6965, -0.6965],\n",
      "          ...,\n",
      "          [ 0.0912, -0.2856, -0.6623,  ...,  0.0569,  0.0227, -0.1486],\n",
      "          [-0.0287,  0.0398,  0.0227,  ..., -0.1486, -0.4054, -0.4568],\n",
      "          [-0.0458, -0.2856, -0.1828,  ..., -0.1143, -0.0458, -0.1143]],\n",
      "\n",
      "         [[ 0.5903,  0.5903,  0.4503,  ..., -0.4601, -0.2325, -0.3550],\n",
      "          [ 0.2577,  0.2927,  0.4503,  ..., -0.4426, -0.1975, -0.2325],\n",
      "          [-0.0399, -0.0224,  0.1527,  ..., -0.3375, -0.0924, -0.0749],\n",
      "          ...,\n",
      "          [ 1.1155,  0.7829,  0.3803,  ...,  1.1506,  1.0280,  0.7479],\n",
      "          [ 1.0280,  1.0805,  1.0455,  ...,  1.0280,  0.6604,  0.4328],\n",
      "          [ 0.9930,  0.7829,  0.8880,  ...,  0.9580,  0.9230,  0.7829]],\n",
      "\n",
      "         [[ 0.0779, -0.3753, -0.7587,  ..., -1.1944, -1.1944, -1.2467],\n",
      "          [-0.5670, -0.8981, -0.7587,  ..., -1.0898, -1.0724, -1.1247],\n",
      "          [-1.1596, -1.1770, -1.0201,  ..., -0.9504, -0.8981, -1.0027],\n",
      "          ...,\n",
      "          [-0.0267, -0.5495, -0.7413,  ..., -0.5495, -0.6890, -0.4973],\n",
      "          [ 0.0256,  0.0779,  0.2173,  ..., -0.8110, -0.8110, -0.6018],\n",
      "          [-0.0441, -0.3404,  0.0953,  ..., -0.2707,  0.2173,  0.1999]]],\n",
      "\n",
      "\n",
      "        [[[ 2.1462,  2.0948,  1.6667,  ..., -1.1418, -0.4568,  1.1700],\n",
      "          [ 1.9920,  2.0777,  1.5982,  ..., -0.7650,  0.8961,  1.8037],\n",
      "          [ 1.4269,  1.6495,  1.6838,  ..., -0.7822,  1.0159,  0.9646],\n",
      "          ...,\n",
      "          [-1.2617, -1.1247, -1.2103,  ..., -1.2959, -1.2274, -0.9363],\n",
      "          [-1.1247, -1.1418, -1.1247,  ..., -1.2959, -1.1589, -0.9363],\n",
      "          [-1.3473, -1.6213, -1.5870,  ..., -1.4329, -1.0562, -0.8678]],\n",
      "\n",
      "         [[ 2.3761,  2.3060,  1.8859,  ..., -1.2129, -0.4426,  1.2906],\n",
      "          [ 2.2185,  2.3235,  1.8508,  ..., -0.7752,  1.0280,  2.0259],\n",
      "          [ 1.6758,  1.9209,  1.9209,  ..., -0.7577,  1.1331,  1.0805],\n",
      "          ...,\n",
      "          [-1.3004, -1.0553, -1.1253,  ..., -1.4055, -1.3880, -1.2129],\n",
      "          [-0.9153, -0.9678, -0.9853,  ..., -1.4055, -1.2829, -1.0903],\n",
      "          [-1.1078, -1.4055, -1.3704,  ..., -1.5105, -1.1253, -0.9678]],\n",
      "\n",
      "         [[ 2.5354,  2.5180,  2.2391,  ..., -0.6715, -0.0441,  1.5594],\n",
      "          [ 2.4308,  2.5006,  2.2391,  ..., -0.3230,  1.3502,  2.2740],\n",
      "          [ 2.1346,  2.2740,  2.2043,  ..., -0.3055,  1.4722,  1.4025],\n",
      "          ...,\n",
      "          [-1.3513, -1.1770, -1.2467,  ..., -1.4036, -1.4210, -1.2293],\n",
      "          [-1.1073, -1.1944, -1.1944,  ..., -1.4559, -1.3513, -1.1073],\n",
      "          [-1.2641, -1.4559, -1.4210,  ..., -1.5430, -1.2119, -1.0201]]]])\n",
      "captions: tensor([[    0,  1025,    13,  3271,    52,   555,    45,   536,  1224,\n",
      "            18,     1],\n",
      "        [    0,     3,    94,   454,   170,    79,   251,  3723,  1554,\n",
      "            18,     1],\n",
      "        [    0,     3,   432,   130,   519,   192,    32,    14,   198,\n",
      "            18,     1],\n",
      "        [    0,     3,   134,   135,    21,     3,  1946,    39,    16,\n",
      "           526,     1],\n",
      "        [    0,     3,   124,    14,    21,    20,    85,     6,    60,\n",
      "            89,     1],\n",
      "        [    0,     3,   169,   111,     3,  6522,  1373,  1400,   272,\n",
      "            18,     1],\n",
      "        [    0,    32,   906,   130,  4825,     3,     4,   335,  1924,\n",
      "            18,     1],\n",
      "        [    0,     3,     8,  5904,   113,   577,   224,    39,     3,\n",
      "           112,     1],\n",
      "        [    0,     3,  4094,  3455,   136,    77,     3,   724,   191,\n",
      "            18,     1],\n",
      "        [    0,     3,    80,    13,  1310,   135,    39,     3,  5352,\n",
      "           594,     1]])\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "import torch.utils.data as data\n",
    "\n",
    "# Randomly sample a caption length, and sample indices with that length.\n",
    "indices = data_loader.dataset.get_train_indices()\n",
    "print('sampled indices:', indices)\n",
    "\n",
    "# Create and assign a batch sampler to retrieve a batch with the sampled indices.\n",
    "new_sampler = data.sampler.SubsetRandomSampler(indices=indices)\n",
    "data_loader.batch_sampler.sampler = new_sampler\n",
    "    \n",
    "# Obtain the batch.\n",
    "images, captions = next(iter(data_loader))\n",
    "\n",
    "\n",
    "print('images.shape:', images.shape)\n",
    "print('captions.shape:', captions.shape)\n",
    "\n",
    "# (Optional) Uncomment the lines of code below to print the pre-processed images and captions.\n",
    "print('images:', images)\n",
    "print('captions:', captions)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "sampled indices: [375585, 324723, 254187, 157433, 69593, 29418, 203321, 36442, 256484, 287417]\n",
      "images.shape: torch.Size([10, 3, 224, 224])\n",
      "captions.shape: torch.Size([10, 16])\n",
      "images: tensor([[[[-1.1589, -1.2445, -1.2617,  ..., -1.5357, -1.4843, -0.8507],\n",
      "          [-1.3473, -1.2103, -1.1418,  ..., -1.6898, -1.6727, -1.5528],\n",
      "          [-1.4158, -1.3644, -1.1932,  ..., -1.7754, -1.8439, -1.8610],\n",
      "          ...,\n",
      "          [-0.8164, -0.8164, -0.8164,  ..., -1.0219, -1.0219, -1.0048],\n",
      "          [-0.7993, -0.7822, -0.7822,  ..., -0.9705, -0.9534, -0.9534],\n",
      "          [-0.7650, -0.7993, -0.7993,  ..., -0.9363, -0.8678, -0.9020]],\n",
      "\n",
      "         [[-0.9328, -1.0553, -1.1078,  ..., -1.4230, -1.5455, -0.8627],\n",
      "          [-1.2304, -1.0728, -1.0028,  ..., -1.5980, -1.7731, -1.7381],\n",
      "          [-1.3880, -1.3004, -1.1078,  ..., -1.6681, -1.7731, -1.8081],\n",
      "          ...,\n",
      "          [-0.6352, -0.6176, -0.6352,  ..., -0.8277, -0.8277, -0.8277],\n",
      "          [-0.6001, -0.5826, -0.5651,  ..., -0.8102, -0.7927, -0.7752],\n",
      "          [-0.6176, -0.6001, -0.6001,  ..., -0.8102, -0.7402, -0.7402]],\n",
      "\n",
      "         [[-0.6890, -0.8458, -0.9504,  ..., -1.3687, -1.1770, -0.3578],\n",
      "          [-1.0376, -0.8458, -0.7936,  ..., -1.4036, -1.4907, -1.4036],\n",
      "          [-1.2641, -1.0898, -0.8458,  ..., -1.4559, -1.6650, -1.5604],\n",
      "          ...,\n",
      "          [-0.3578, -0.3927, -0.4101,  ..., -0.5495, -0.5495, -0.5495],\n",
      "          [-0.3404, -0.3404, -0.3404,  ..., -0.5321, -0.5147, -0.4973],\n",
      "          [-0.4101, -0.3927, -0.3753,  ..., -0.5321, -0.4624, -0.4624]]],\n",
      "\n",
      "\n",
      "        [[[-0.0629,  0.0912,  0.1939,  ..., -1.9295, -1.8610, -1.8439],\n",
      "          [-0.4397, -0.0116, -0.0458,  ..., -1.8953, -1.8953, -1.9124],\n",
      "          [-0.3369, -0.0287, -0.1657,  ..., -1.7583, -1.7925, -1.8268],\n",
      "          ...,\n",
      "          [ 0.7591,  0.7077,  0.8618,  ...,  0.6221,  0.5536,  0.4508],\n",
      "          [ 0.7762,  0.8447,  0.7591,  ...,  0.4851,  0.4337,  0.2796],\n",
      "          [-1.3473, -1.3130, -1.3473,  ..., -1.4329, -1.4158, -1.4672]],\n",
      "\n",
      "         [[ 0.1352, -0.0399,  0.3277,  ..., -1.8256, -1.7556, -1.8081],\n",
      "          [-0.3025,  0.0476,  0.1527,  ..., -1.7906, -1.7906, -1.8606],\n",
      "          [-0.3550, -0.1450, -0.0574,  ..., -1.6506, -1.6856, -1.6681],\n",
      "          ...,\n",
      "          [ 1.0455,  1.0805,  1.2206,  ...,  0.8004,  0.7654,  0.6429],\n",
      "          [ 1.1331,  1.1331,  1.0280,  ...,  0.6429,  0.6078,  0.4853],\n",
      "          [-1.0903, -1.1779, -1.2304,  ..., -1.3179, -1.2654, -1.3179]],\n",
      "\n",
      "         [[ 0.3219, -0.5321,  0.1651,  ..., -1.5256, -1.4907, -1.5430],\n",
      "          [-0.3055, -0.6193, -0.1312,  ..., -1.4907, -1.4907, -1.5604],\n",
      "          [-0.0790, -0.2881, -0.2184,  ..., -1.3513, -1.3861, -1.3861],\n",
      "          ...,\n",
      "          [ 1.2631,  1.2631,  1.4025,  ...,  0.9842,  0.9319,  0.8274],\n",
      "          [ 1.2980,  1.3328,  1.2457,  ...,  0.9145,  0.8448,  0.6705],\n",
      "          [-0.8981, -0.9156, -0.9678,  ..., -1.0724, -1.0898, -1.1421]]],\n",
      "\n",
      "\n",
      "        [[[ 0.7248,  0.7419,  0.7762,  ...,  0.1083,  0.0912,  0.0569],\n",
      "          [ 0.7591,  0.7762,  0.7933,  ...,  0.1254,  0.0227, -0.0801],\n",
      "          [ 0.7762,  0.7933,  0.8104,  ..., -0.0629, -0.1828, -0.2856],\n",
      "          ...,\n",
      "          [ 1.1872,  1.1187,  1.1187,  ...,  1.0331,  1.0331,  0.9988],\n",
      "          [ 1.1015,  1.1015,  1.0844,  ...,  1.0673,  1.0673,  1.0673],\n",
      "          [ 1.1015,  1.1015,  1.1529,  ...,  0.8961,  1.0673,  1.0331]],\n",
      "\n",
      "         [[ 0.1001,  0.1176,  0.1527,  ..., -0.3375, -0.3550, -0.3725],\n",
      "          [ 0.1352,  0.1527,  0.1702,  ..., -0.3200, -0.4076, -0.4951],\n",
      "          [ 0.1527,  0.1702,  0.1877,  ..., -0.5126, -0.6352, -0.7052],\n",
      "          ...,\n",
      "          [ 0.8704,  0.8004,  0.8004,  ...,  0.6779,  0.6779,  0.6429],\n",
      "          [ 0.7654,  0.7654,  0.7479,  ...,  0.7129,  0.7129,  0.7129],\n",
      "          [ 0.7654,  0.7654,  0.8179,  ...,  0.5378,  0.7129,  0.6779]],\n",
      "\n",
      "         [[-0.2881, -0.2707, -0.2532,  ..., -0.6890, -0.7413, -0.7761],\n",
      "          [-0.2881, -0.2707, -0.2532,  ..., -0.6890, -0.7936, -0.8633],\n",
      "          [-0.2707, -0.2532, -0.2358,  ..., -0.8284, -0.9504, -1.0027],\n",
      "          ...,\n",
      "          [ 0.8971,  0.8274,  0.8274,  ...,  0.6182,  0.6182,  0.6008],\n",
      "          [ 0.7925,  0.7925,  0.7751,  ...,  0.6356,  0.6531,  0.6531],\n",
      "          [ 0.7925,  0.7751,  0.8274,  ...,  0.4788,  0.6705,  0.6356]]],\n",
      "\n",
      "\n",
      "        ...,\n",
      "\n",
      "\n",
      "        [[[ 0.6049,  0.5878,  0.6221,  ...,  0.1939,  0.1597,  0.1939],\n",
      "          [ 0.5022,  0.4508,  0.5022,  ...,  0.1426,  0.1597,  0.2111],\n",
      "          [ 0.3823,  0.3138,  0.3309,  ...,  0.1254,  0.1597,  0.1426],\n",
      "          ...,\n",
      "          [-1.8268, -1.6555, -1.6727,  ...,  1.9064,  1.9407,  1.9407],\n",
      "          [-1.2788, -1.7069, -1.5699,  ...,  1.8893,  1.9064,  1.9235],\n",
      "          [-1.1418, -1.4158, -1.3473,  ...,  1.8550,  1.8550,  1.8722]],\n",
      "\n",
      "         [[ 0.8354,  0.8354,  0.8179,  ...,  0.4328,  0.4503,  0.4678],\n",
      "          [ 0.8179,  0.7829,  0.7654,  ...,  0.3978,  0.3978,  0.4328],\n",
      "          [ 0.7129,  0.6779,  0.6254,  ...,  0.4153,  0.3978,  0.3803],\n",
      "          ...,\n",
      "          [-1.5105, -1.4405, -1.4930,  ...,  1.9734,  1.9909,  2.0084],\n",
      "          [-0.9503, -1.5105, -1.2304,  ...,  1.9559,  1.9734,  1.9909],\n",
      "          [-0.8452, -1.1078, -0.9853,  ...,  1.9209,  1.9209,  1.9384]],\n",
      "\n",
      "         [[ 1.1411,  1.1585,  1.1585,  ...,  0.6008,  0.6008,  0.6356],\n",
      "          [ 1.1411,  1.1585,  1.1585,  ...,  0.6008,  0.5834,  0.6182],\n",
      "          [ 1.0714,  1.0888,  1.1062,  ...,  0.6008,  0.5834,  0.5485],\n",
      "          ...,\n",
      "          [-1.6824, -1.6476, -1.6302,  ...,  1.9603,  1.9777,  1.9777],\n",
      "          [-1.3861, -1.6302, -1.5953,  ...,  1.9603,  1.9428,  1.9603],\n",
      "          [-1.2990, -1.4559, -1.5953,  ...,  1.9254,  1.9080,  1.9254]]],\n",
      "\n",
      "\n",
      "        [[[ 1.1358,  0.8789,  0.9646,  ...,  0.9988,  1.1015,  1.0331],\n",
      "          [ 1.1872,  1.0159,  0.8447,  ...,  0.8961,  1.1358,  0.9303],\n",
      "          [ 1.4440,  1.1015,  0.9303,  ...,  0.8618,  1.0502,  1.0502],\n",
      "          ...,\n",
      "          [ 0.2282, -0.0287, -0.2856,  ..., -1.2103, -1.1075, -1.1589],\n",
      "          [ 0.5193,  0.1426,  0.3138,  ..., -1.2274, -1.0562, -1.0733],\n",
      "          [ 0.2111,  0.4166,  0.4166,  ..., -1.2103, -1.1075, -0.9534]],\n",
      "\n",
      "         [[ 0.8004,  0.4678,  0.5553,  ...,  0.7129,  0.8004,  0.7304],\n",
      "          [ 0.9055,  0.6254,  0.3803,  ...,  0.5728,  0.7829,  0.6254],\n",
      "          [ 1.1856,  0.6954,  0.4328,  ...,  0.4853,  0.6604,  0.6779],\n",
      "          ...,\n",
      "          [ 0.1702, -0.0574, -0.3725,  ..., -0.6352, -0.4951, -0.5651],\n",
      "          [ 0.4153,  0.0301,  0.1702,  ..., -0.7577, -0.6527, -0.6352],\n",
      "          [-0.0049,  0.2752,  0.2927,  ..., -0.6702, -0.6352, -0.6352]],\n",
      "\n",
      "         [[ 0.0431, -0.0615, -0.1138,  ..., -0.2532, -0.0964, -0.1835],\n",
      "          [ 0.3219,  0.0431, -0.3753,  ..., -0.4973, -0.2881, -0.5321],\n",
      "          [ 0.7054,  0.0256, -0.3404,  ..., -0.3404, -0.3055, -0.3230],\n",
      "          ...,\n",
      "          [-0.0790, -0.3055, -0.5844,  ..., -1.2467, -1.1247, -1.1770],\n",
      "          [ 0.1825, -0.1661,  0.0256,  ..., -1.3339, -1.2119, -1.1770],\n",
      "          [-0.2010,  0.0605,  0.0953,  ..., -1.2467, -1.1944, -1.0724]]],\n",
      "\n",
      "\n",
      "        [[[-0.4054, -0.4568, -0.4397,  ..., -1.8953, -1.8782, -1.8782],\n",
      "          [-0.4568, -0.4226, -0.3883,  ..., -1.8953, -1.8439, -1.8782],\n",
      "          [-0.4739, -0.4054, -0.4226,  ..., -1.9124, -1.8782, -1.8782],\n",
      "          ...,\n",
      "          [-0.5082, -0.4226, -0.4397,  ..., -0.1486, -0.0629, -0.0972],\n",
      "          [-0.5424, -0.4739, -0.5596,  ...,  0.0227,  0.0227,  0.0398],\n",
      "          [-0.5424, -0.4911, -0.6281,  ..., -0.0287,  0.0056,  0.0056]],\n",
      "\n",
      "         [[-0.3375, -0.2850, -0.3025,  ..., -1.7906, -1.7731, -1.7731],\n",
      "          [-0.3550, -0.2675, -0.2850,  ..., -1.8081, -1.7556, -1.7731],\n",
      "          [-0.4076, -0.2675, -0.2500,  ..., -1.8081, -1.7906, -1.7731],\n",
      "          ...,\n",
      "          [-0.4076, -0.3901, -0.4601,  ..., -0.2150, -0.1450, -0.1275],\n",
      "          [-0.5126, -0.5126, -0.5476,  ..., -0.0224, -0.0399, -0.0399],\n",
      "          [-0.5301, -0.4951, -0.6352,  ..., -0.0399, -0.0399,  0.0126]],\n",
      "\n",
      "         [[-0.0615,  0.0431,  0.0779,  ..., -1.5430, -1.5081, -1.5430],\n",
      "          [-0.0790, -0.0964,  0.0779,  ..., -1.5430, -1.4907, -1.5081],\n",
      "          [-0.1487, -0.0092,  0.0256,  ..., -1.5430, -1.5779, -1.5430],\n",
      "          ...,\n",
      "          [-0.2184, -0.1138, -0.2358,  ..., -0.0441,  0.0605,  0.0431],\n",
      "          [-0.3055, -0.3230, -0.2881,  ...,  0.0431,  0.0431,  0.1302],\n",
      "          [-0.2010, -0.3055, -0.3404,  ...,  0.1128,  0.1302,  0.1651]]]])\n",
      "captions: tensor([[    0,     3,   953,   254,  1342,     3,  2323,  4062,   161,\n",
      "          5976,   161,  1596,     3,   353,    18,     1],\n",
      "        [    0,     3,   334,    13,     3,   169,    77,   468,  6087,\n",
      "           207,   793,    39,     3,   829,    18,     1],\n",
      "        [    0,     3,   253,   169,   130,   296,   161,  3632,   139,\n",
      "            32,   829,    39,   160,   354,    18,     1],\n",
      "        [    0,   366,  7083,    52,  1728,   294,    39,    32,  1966,\n",
      "            13,     3,   437,    13,   278,    18,     1],\n",
      "        [    0,     3,   254,    77,    20,   355,  1481,    39,     3,\n",
      "           760,    39,     3,   226,   592,    18,     1],\n",
      "        [    0,    46,   130,  1211,  3658,    64,    14,   198,   587,\n",
      "           968,     4,   953,    39,   715,    18,     1],\n",
      "        [    0,   335,  1466,    39,    32,  2693,    21,   211,  2837,\n",
      "             2,   784,  1631,    77,  4295,    18,     1],\n",
      "        [    0,     3,   169,  4360,   523,    98,    21,     3,  4472,\n",
      "           586,  1632,     3,  5096,  1598,    18,     1],\n",
      "        [    0,   366,    51,   355,    21,     3,    20,   356,   111,\n",
      "            32,   388,    13,     3,   442,    18,     1],\n",
      "        [    0,     3,   334,    13,     3,    50,   468,  5178,    21,\n",
      "          1210,    39,    50,    20,   328,    18,     1]])\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "import torch.utils.data as data\n",
    "\n",
    "# Randomly sample a caption length, and sample indices with that length.\n",
    "indices = data_loader.dataset.get_train_indices()\n",
    "print('sampled indices:', indices)\n",
    "\n",
    "# Create and assign a batch sampler to retrieve a batch with the sampled indices.\n",
    "new_sampler = data.sampler.SubsetRandomSampler(indices=indices)\n",
    "data_loader.batch_sampler.sampler = new_sampler\n",
    "    \n",
    "# Obtain the batch.\n",
    "images, captions = next(iter(data_loader))\n",
    "\n",
    "\n",
    "print('images.shape:', images.shape)\n",
    "print('captions.shape:', captions.shape)\n",
    "\n",
    "# (Optional) Uncomment the lines of code below to print the pre-processed images and captions.\n",
    "print('images:', images)\n",
    "print('captions:', captions)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id='step3'></a>\n",
    "## Step 3: Experiment with the CNN Encoder\n",
    "\n",
    "Run the code cell below to import `EncoderCNN` and `DecoderRNN` from **model.py**. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Watch for any changes in model.py, and re-load it automatically.\n",
    "% load_ext autoreload\n",
    "% autoreload 2\n",
    "\n",
    "# Import EncoderCNN and DecoderRNN. \n",
    "from model import EncoderCNN, DecoderRNN\n",
    "\n",
    "import torch"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the next code cell we define a `device` that you will use move PyTorch tensors to GPU (if CUDA is available).  Run this code cell before continuing."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Run the code cell below to instantiate the CNN encoder in `encoder`.  \n",
    "\n",
    "The pre-processed images from the batch in **Step 2** of this notebook are then passed through the encoder, and the output is stored in `features`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Downloading: \"https://download.pytorch.org/models/resnet50-19c8e357.pth\" to /root/.torch/models/resnet50-19c8e357.pth\n",
      "100%|██████████| 102502400/102502400 [00:01<00:00, 78266964.24it/s]\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "type(features): <class 'torch.Tensor'>\n",
      "features.shape: torch.Size([10, 256])\n"
     ]
    }
   ],
   "source": [
    "# Specify the dimensionality of the image embedding.\n",
    "embed_size = 256\n",
    "\n",
    "#-#-#-# Do NOT modify the code below this line. #-#-#-#\n",
    "\n",
    "# Initialize the encoder. (Optional: Add additional arguments if necessary.)\n",
    "encoder = EncoderCNN(embed_size)\n",
    "\n",
    "# Move the encoder to GPU if CUDA is available.\n",
    "encoder.to(device)\n",
    "    \n",
    "# Move last batch of images (from Step 2) to GPU if CUDA is available.   \n",
    "images = images.to(device)\n",
    "\n",
    "# Pass the images through the encoder.\n",
    "features = encoder(images)\n",
    "\n",
    "print('type(features):', type(features))\n",
    "print('features.shape:', features.shape)\n",
    "\n",
    "# Check that your encoder satisfies some requirements of the project! :D\n",
    "assert type(features)==torch.Tensor, \"Encoder output needs to be a PyTorch Tensor.\" \n",
    "assert (features.shape[0]==batch_size) & (features.shape[1]==embed_size), \"The shape of the encoder output is incorrect.\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The encoder that we provide to you uses the pre-trained ResNet-50 architecture (with the final fully-connected layer removed) to extract features from a batch of pre-processed images.  The output is then flattened to a vector, before being passed through a `Linear` layer to transform the feature vector to have the same size as the word embedding.\n",
    "\n",
    "![Encoder](images/encoder.png)\n",
    "\n",
    "You are welcome (and encouraged) to amend the encoder in **model.py**, to experiment with other architectures.  In particular, consider using a [different pre-trained model architecture](http://pytorch.org/docs/master/torchvision/models.html).  You may also like to [add batch normalization](http://pytorch.org/docs/master/nn.html#normalization-layers).  \n",
    "\n",
    "> You are **not** required to change anything about the encoder.\n",
    "\n",
    "For this project, you **must** incorporate a pre-trained CNN into your encoder.  Your `EncoderCNN` class must take `embed_size` as an input argument, which will also correspond to the dimensionality of the input to the RNN decoder that you will implement in Step 4.  When you train your model in the next notebook in this sequence (**2_Training.ipynb**), you are welcome to tweak the value of `embed_size`.\n",
    "\n",
    "If you decide to modify the `EncoderCNN` class, save **model.py** and re-execute the code cell above.  If the code cell returns an assertion error, then please follow the instructions to modify your code before proceeding.  The assert statements ensure that `features` is a PyTorch tensor with shape `[batch_size, embed_size]`."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id='step4'></a>\n",
    "## Step 4: Implement the RNN Decoder\n",
    "\n",
    "Before executing the next code cell, you must write `__init__` and `forward` methods in the `DecoderRNN` class in **model.py**.  (Do **not** write the `sample` method yet - you will work with this method when you reach **3_Inference.ipynb**.)\n",
    "\n",
    "> The `__init__` and `forward` methods in the `DecoderRNN` class are the only things that you **need** to modify as part of this notebook.  You will write more implementations in the notebooks that appear later in the sequence.\n",
    "\n",
    "Your decoder will be an instance of the `DecoderRNN` class and must accept as input:\n",
    "- the PyTorch tensor `features` containing the embedded image features (outputted in Step 3, when the last batch of images from Step 2 was passed through `encoder`), along with\n",
    "- a PyTorch tensor corresponding to the last batch of captions (`captions`) from Step 2.\n",
    "\n",
    "Note that the way we have written the data loader should simplify your code a bit.  In particular, every training batch will contain pre-processed captions where all have the same length (`captions.shape[1]`), so **you do not need to worry about padding**.  \n",
    "> While you are encouraged to implement the decoder described in [this paper](https://arxiv.org/pdf/1411.4555.pdf), you are welcome to implement any architecture of your choosing, as long as it uses at least one RNN layer, with hidden dimension `hidden_size`.  \n",
    "\n",
    "Although you will test the decoder using the last batch that is currently stored in the notebook, your decoder should be written to accept an arbitrary batch (of embedded image features and pre-processed captions [where all captions have the same length]) as input.  \n",
    "\n",
    "![Decoder](images/decoder.png)\n",
    "\n",
    "In the code cell below, `outputs` should be a PyTorch tensor with size `[batch_size, captions.shape[1], vocab_size]`.  Your output should be designed such that `outputs[i,j,k]` contains the model's predicted score, indicating how likely the `j`-th token in the `i`-th caption in the batch is the `k`-th token in the vocabulary.  In the next notebook of the sequence (**2_Training.ipynb**), we provide code to supply these scores to the [`torch.nn.CrossEntropyLoss`](http://pytorch.org/docs/master/nn.html#torch.nn.CrossEntropyLoss) optimizer in PyTorch."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "type(outputs): <class 'torch.Tensor'>\n",
      "outputs.shape: torch.Size([10, 12, 8855])\n"
     ]
    }
   ],
   "source": [
    "#vr print all sizes of all different layers\n",
    "\n",
    "# Specify the number of features in the hidden state of the RNN decoder.\n",
    "hidden_size = 512\n",
    "\n",
    "#-#-#-# Do NOT modify the code below this line. #-#-#-#\n",
    "\n",
    "# Store the size of the vocabulary.\n",
    "vocab_size = len(data_loader.dataset.vocab)\n",
    "\n",
    "# Initialize the decoder.\n",
    "decoder = DecoderRNN(embed_size, hidden_size, vocab_size)\n",
    "\n",
    "# Move the decoder to GPU if CUDA is available.\n",
    "decoder.to(device)\n",
    "    \n",
    "# Move last batch of captions (from Step 1) to GPU if CUDA is available \n",
    "captions = captions.to(device)\n",
    "\n",
    "# Pass the encoder output and captions through the decoder.\n",
    "outputs = decoder(features, captions)\n",
    "\n",
    "print('type(outputs):', type(outputs))\n",
    "print('outputs.shape:', outputs.shape)\n",
    "\n",
    "# Check that your decoder satisfies some requirements of the project! :D\n",
    "assert type(outputs)==torch.Tensor, \"Decoder output needs to be a PyTorch Tensor.\"\n",
    "assert (outputs.shape[0]==batch_size) & (outputs.shape[1]==captions.shape[1]) & (outputs.shape[2]==vocab_size), \"The shape of the decoder output is incorrect.\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "When you train your model in the next notebook in this sequence (**2_Training.ipynb**), you are welcome to tweak the value of `hidden_size`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# For reference Copy of full output with all layer sizes - Do not delete / rerun"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "embed_size 256\n",
      "hidden_size 512\n",
      "vocab_size 8855\n",
      "features size torch.Size([10, 256])\n",
      "captions size torch.Size([10, 12])\n",
      "captions tensor([[    0,     3,  4266,   777,    21,  2168,    86,  4363,     6,\n",
      "           329,    18,     1],\n",
      "        [    0,     3,  1313,   890,   854,   980,    54,    32,   854,\n",
      "          1902,    18,     1],\n",
      "        [    0,     3,   953,   363,   324,    77,     3,   582,  1098,\n",
      "           325,    18,     1],\n",
      "        [    0,     3,   254,   285,   111,   160,   335,   921,    13,\n",
      "          2051,    18,     1],\n",
      "        [    0,    47,   559,  1300,   902,   111,     3,  1300,   902,\n",
      "          5653,    18,     1],\n",
      "        [    0,    47,  2290,    13,  1049,  1635,     6,   329,    52,\n",
      "           918,    18,     1],\n",
      "        [    0,     3,   363,  1053,   263,  1558,    39,     3,  1481,\n",
      "           760,    18,     1],\n",
      "        [    0,     3,   169,    21,  1479,    77,   380,     6,     3,\n",
      "          1318,    18,     1],\n",
      "        [    0,     3,   679,   266,    13,   468,  3046,     6,  2844,\n",
      "            39,   257,     1],\n",
      "        [    0,     3,  1162,    13,  1302,   272,   364,   161,     3,\n",
      "          4497,    18,     1]], device='cuda:0')\n",
      "reduced_captions size torch.Size([10, 11])\n",
      "reduced_captions tensor([[    0,     3,  4266,   777,    21,  2168,    86,  4363,     6,\n",
      "           329,    18],\n",
      "        [    0,     3,  1313,   890,   854,   980,    54,    32,   854,\n",
      "          1902,    18],\n",
      "        [    0,     3,   953,   363,   324,    77,     3,   582,  1098,\n",
      "           325,    18],\n",
      "        [    0,     3,   254,   285,   111,   160,   335,   921,    13,\n",
      "          2051,    18],\n",
      "        [    0,    47,   559,  1300,   902,   111,     3,  1300,   902,\n",
      "          5653,    18],\n",
      "        [    0,    47,  2290,    13,  1049,  1635,     6,   329,    52,\n",
      "           918,    18],\n",
      "        [    0,     3,   363,  1053,   263,  1558,    39,     3,  1481,\n",
      "           760,    18],\n",
      "        [    0,     3,   169,    21,  1479,    77,   380,     6,     3,\n",
      "          1318,    18],\n",
      "        [    0,     3,   679,   266,    13,   468,  3046,     6,  2844,\n",
      "            39,   257],\n",
      "        [    0,     3,  1162,    13,  1302,   272,   364,   161,     3,\n",
      "          4497,    18]], device='cuda:0')\n",
      "embeddeded_captions size torch.Size([10, 11, 256])\n",
      "embeddeded_captions  tensor([[[-1.1482e-01,  8.2333e-01, -3.1716e-01,  ...,  1.1209e-01,\n",
      "          -1.2277e+00, -1.7862e+00],\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         [-2.1639e+00,  1.5459e+00, -1.4213e+00,  ...,  2.6570e-01,\n",
      "          -2.3261e+00,  8.1873e-01],\n",
      "         ...,\n",
      "         [-4.2025e-01,  1.5465e+00, -7.1158e-01,  ...,  8.3160e-02,\n",
      "           2.2956e+00, -1.7981e-01],\n",
      "         [-3.1903e-01, -8.8822e-01,  1.1850e+00,  ...,  9.9924e-01,\n",
      "          -2.4681e+00, -4.7401e-01],\n",
      "         [ 7.3205e-01,  2.5770e-01,  2.0781e+00,  ...,  2.9537e-01,\n",
      "           8.9930e-01,  5.3815e-01]],\n",
      "\n",
      "        [[-1.1482e-01,  8.2333e-01, -3.1716e-01,  ...,  1.1209e-01,\n",
      "          -1.2277e+00, -1.7862e+00],\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         [-9.2682e-01,  5.8086e-01, -7.7555e-03,  ..., -6.9245e-01,\n",
      "          -1.3211e+00, -5.0128e-01],\n",
      "         ...,\n",
      "         [ 2.7244e+00,  9.8465e-01,  7.6766e-01,  ...,  6.7067e-01,\n",
      "          -2.0194e-01,  5.7890e-01],\n",
      "         [-1.4458e+00,  5.8691e-01, -4.5609e-01,  ...,  8.0287e-01,\n",
      "          -9.0601e-01, -6.8945e-01],\n",
      "         [ 7.3205e-01,  2.5770e-01,  2.0781e+00,  ...,  2.9537e-01,\n",
      "           8.9930e-01,  5.3815e-01]],\n",
      "\n",
      "        [[-1.1482e-01,  8.2333e-01, -3.1716e-01,  ...,  1.1209e-01,\n",
      "          -1.2277e+00, -1.7862e+00],\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         [ 2.2966e+00,  1.3672e+00,  4.8429e-01,  ...,  9.8632e-01,\n",
      "           4.3467e-01, -1.4165e+00],\n",
      "         ...,\n",
      "         [ 2.8731e-01, -1.1558e-01,  1.5513e-02,  ..., -1.0197e+00,\n",
      "          -7.9557e-01, -9.1092e-02],\n",
      "         [-9.7444e-01, -3.5782e-01,  1.2849e+00,  ...,  6.7038e-01,\n",
      "          -2.2083e-01, -1.2066e+00],\n",
      "         [ 7.3205e-01,  2.5770e-01,  2.0781e+00,  ...,  2.9537e-01,\n",
      "           8.9930e-01,  5.3815e-01]],\n",
      "\n",
      "        ...,\n",
      "\n",
      "        [[-1.1482e-01,  8.2333e-01, -3.1716e-01,  ...,  1.1209e-01,\n",
      "          -1.2277e+00, -1.7862e+00],\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         [-5.4099e-02, -8.9389e-01, -1.6174e-01,  ...,  1.1938e-01,\n",
      "          -1.7062e-01,  8.7400e-01],\n",
      "         ...,\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         [-2.8189e-01, -6.6288e-01, -1.2132e+00,  ...,  3.3652e-01,\n",
      "           6.4154e-01,  1.6252e+00],\n",
      "         [ 7.3205e-01,  2.5770e-01,  2.0781e+00,  ...,  2.9537e-01,\n",
      "           8.9930e-01,  5.3815e-01]],\n",
      "\n",
      "        [[-1.1482e-01,  8.2333e-01, -3.1716e-01,  ...,  1.1209e-01,\n",
      "          -1.2277e+00, -1.7862e+00],\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         [-7.5994e-01, -1.8967e+00,  5.0359e-01,  ..., -1.7045e+00,\n",
      "          -4.0962e-01, -6.0717e-01],\n",
      "         ...,\n",
      "         [-1.6021e-01, -5.6203e-01,  7.2017e-01,  ..., -1.5052e+00,\n",
      "           3.2105e-01, -1.4497e-01],\n",
      "         [-1.8472e+00, -1.3512e+00, -1.4133e+00,  ..., -5.0516e-01,\n",
      "          -1.1378e+00, -4.8026e-01],\n",
      "         [-1.4507e+00,  4.8039e-01, -2.9335e-02,  ...,  3.5409e-02,\n",
      "           6.1306e-01,  1.0780e+00]],\n",
      "\n",
      "        [[-1.1482e-01,  8.2333e-01, -3.1716e-01,  ...,  1.1209e-01,\n",
      "          -1.2277e+00, -1.7862e+00],\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         [-8.7266e-02, -9.3160e-01, -5.9327e-01,  ...,  2.0046e+00,\n",
      "          -1.0512e+00, -1.3475e+00],\n",
      "         ...,\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         [-2.7104e-02,  1.0107e+00, -1.8487e-01,  ...,  1.7162e-01,\n",
      "           2.2215e-01,  2.4007e-01],\n",
      "         [ 7.3205e-01,  2.5770e-01,  2.0781e+00,  ...,  2.9537e-01,\n",
      "           8.9930e-01,  5.3815e-01]]], device='cuda:0')\n",
      "unsqueezed_features size torch.Size([10, 1, 256])\n",
      "unsqueezed_features  tensor([[[-4.0973e-01,  3.1127e-01,  3.7831e-01,  6.4579e-02, -3.0028e-01,\n",
      "           3.5999e-01, -2.2399e-01, -3.6572e-01, -1.8306e-01,  2.5258e-01,\n",
      "           5.1903e-02, -9.5619e-02, -1.3555e-01,  2.6047e-01, -1.3888e-01,\n",
      "          -8.5970e-02,  2.7099e-01, -2.5222e-01,  1.0850e-01, -2.1343e-02,\n",
      "           5.7617e-02, -2.3933e-02, -2.4315e-01, -3.0196e-01,  1.5697e-01,\n",
      "          -5.2436e-02,  3.3324e-01, -4.5114e-01, -2.3763e-02, -9.1460e-02,\n",
      "           1.7927e-01,  6.1039e-01,  1.8593e-02,  6.8228e-01,  6.0341e-02,\n",
      "           1.2883e-01, -4.8531e-01, -5.6755e-02, -5.8072e-01,  7.5526e-02,\n",
      "           2.6052e-02,  6.6844e-02, -7.0445e-01, -4.5713e-02,  2.9317e-02,\n",
      "           6.0134e-02,  4.8469e-01, -3.5252e-01, -1.8941e-03,  5.9177e-02,\n",
      "          -1.2531e-02,  3.1293e-01,  5.0114e-01, -1.5345e-01, -3.8936e-02,\n",
      "          -2.0368e-01, -2.3716e-02, -2.5928e-02,  1.8516e-02,  3.8078e-02,\n",
      "          -3.3630e-01,  3.2266e-01,  2.6150e-01, -6.6075e-02,  3.4425e-01,\n",
      "           2.0159e-01,  2.4547e-01,  1.5976e-01,  2.3564e-01, -6.3164e-01,\n",
      "           2.3881e-01, -1.7259e-01, -2.7809e-04,  1.7121e-01,  2.1700e-01,\n",
      "           3.8488e-01, -2.9747e-02,  4.1079e-01, -2.6451e-01,  2.7634e-01,\n",
      "           1.7967e-01, -1.2376e-01, -9.3646e-02, -1.7195e-01,  2.1267e-01,\n",
      "          -4.8660e-01,  2.0739e-01,  4.7897e-01, -1.6617e-02, -9.0854e-03,\n",
      "           9.4910e-02,  1.4955e-01,  1.0222e-01, -2.1996e-01,  1.2341e-01,\n",
      "           3.3957e-01, -2.3819e-01, -3.3654e-01,  2.3981e-01, -2.7509e-01,\n",
      "           4.3646e-01, -3.5826e-01,  1.3195e-01,  4.8486e-01,  5.8344e-01,\n",
      "          -5.1578e-01, -1.4004e-02, -4.4800e-01, -3.1233e-01, -2.7880e-01,\n",
      "           3.2942e-01,  1.5629e-01,  1.0039e-01, -1.1342e-01,  2.9504e-01,\n",
      "          -1.0121e-02,  1.3631e-01, -1.3064e-01,  4.0863e-01,  4.9730e-02,\n",
      "          -3.9767e-02, -4.9738e-02,  1.7208e-01, -2.2940e-01, -4.1784e-02,\n",
      "          -8.3385e-01,  3.5509e-02,  6.9612e-02, -1.4770e-01, -3.1396e-01,\n",
      "           6.3324e-02,  1.4513e-01,  4.1069e-01,  3.3302e-01,  2.9172e-01,\n",
      "          -3.2307e-02,  5.4058e-02, -3.8654e-01,  1.7056e-01, -5.6031e-02,\n",
      "          -1.8756e-01,  4.0105e-01, -6.1781e-02, -4.8477e-02,  3.2001e-01,\n",
      "           1.8613e-01,  7.6157e-01, -6.7959e-02, -2.2220e-01, -2.4874e-01,\n",
      "           3.6873e-02,  4.4021e-01, -2.2507e-01,  5.6627e-01, -1.9961e-01,\n",
      "          -4.7415e-02,  1.7043e-01, -1.0841e-01, -3.8210e-02,  1.2422e-01,\n",
      "           9.8070e-02, -6.7130e-01,  4.0463e-01,  1.3107e-01,  3.8561e-01,\n",
      "           1.2849e-01, -2.5881e-01,  2.6732e-03,  1.7177e-02,  6.9793e-02,\n",
      "          -1.6085e-02,  1.7478e-01, -2.4510e-01, -2.7690e-01, -4.0104e-02,\n",
      "          -2.5775e-01,  4.8707e-01, -6.1886e-02,  5.1288e-01, -7.8374e-02,\n",
      "          -1.3787e-01, -4.8514e-01,  6.4821e-02, -9.2569e-02,  5.5337e-02,\n",
      "          -1.8733e-01, -1.0435e-01,  1.0540e-01, -3.8081e-01,  8.0915e-02,\n",
      "          -8.0113e-03, -5.3967e-01,  2.6969e-02, -2.7591e-01, -1.1916e-01,\n",
      "          -1.2491e-01, -4.2256e-02, -1.5053e-01,  3.9980e-01, -7.8423e-02,\n",
      "          -1.0336e-01, -4.2092e-01, -2.4748e-03,  2.6829e-01, -1.0226e-01,\n",
      "           2.5093e-01,  2.4775e-01, -6.3415e-02,  2.6721e-01, -3.1012e-01,\n",
      "           3.9254e-01, -1.9187e-01, -1.7878e-01,  7.3429e-02, -2.2999e-01,\n",
      "          -1.3559e-01, -1.6086e-01,  6.3950e-01, -9.5582e-02, -1.0597e-01,\n",
      "          -5.6422e-01,  1.0180e-01, -4.5671e-01, -2.2824e-01,  4.2552e-02,\n",
      "          -2.5239e-01,  3.0768e-01, -6.4380e-02, -7.9095e-03, -4.2454e-02,\n",
      "          -1.2289e-01,  2.0508e-01,  4.9219e-02, -7.2643e-02,  4.2693e-02,\n",
      "           6.2163e-01, -9.2895e-02,  8.1480e-02, -9.9939e-03, -1.6895e-01,\n",
      "          -3.4782e-01, -4.1224e-01,  5.8559e-02, -2.0162e-01,  3.4002e-01,\n",
      "           7.9981e-02, -1.1939e-01,  8.4705e-02,  1.1876e-01,  1.7985e-01,\n",
      "          -1.0010e-01,  8.2373e-02,  3.7366e-01,  2.8068e-01, -2.4296e-01,\n",
      "           5.8995e-01]],\n",
      "\n",
      "        [[ 1.0774e-01,  6.0399e-01,  1.2885e-01,  1.4495e-01,  5.2171e-02,\n",
      "           5.8206e-01,  1.4399e-01, -3.4547e-01, -1.2895e-01,  6.2623e-01,\n",
      "           1.5438e-01, -2.7251e-01, -1.9762e-01, -5.3479e-01,  1.0035e-01,\n",
      "           8.2743e-03, -5.5422e-02,  5.6990e-02,  4.0647e-01,  2.0346e-01,\n",
      "           4.9301e-01,  9.2170e-02,  2.4854e-01, -1.7517e-01, -2.0615e-01,\n",
      "          -1.8313e-01,  4.5709e-01, -1.2362e-01, -2.5718e-01, -3.6290e-01,\n",
      "          -1.0808e-01,  3.3059e-01,  4.3708e-01,  7.7127e-01,  1.2356e-01,\n",
      "          -5.9497e-02, -9.4133e-02, -1.0499e-01, -6.0979e-01,  1.7877e-01,\n",
      "           1.9888e-01, -1.5789e-01, -4.0180e-01, -8.1743e-01, -2.4052e-01,\n",
      "           8.5215e-01,  1.1745e-01,  6.4441e-02,  1.0303e-01,  3.8243e-01,\n",
      "           1.7522e-01,  3.8182e-01,  2.4093e-02, -1.4644e-01, -2.7225e-01,\n",
      "          -7.8888e-01,  1.4562e-01, -8.5654e-02, -1.9343e-01, -3.5654e-01,\n",
      "          -3.6817e-01,  1.1963e-01, -8.5157e-02,  2.4359e-01,  3.6376e-03,\n",
      "           2.3619e-01,  3.9835e-01,  4.5932e-03,  4.8425e-01, -7.6296e-02,\n",
      "           4.1712e-01, -1.2847e-01,  6.4114e-02, -2.1944e-01,  2.2052e-01,\n",
      "           4.3084e-01, -1.9707e-01,  4.3649e-01, -3.1003e-01,  3.4659e-01,\n",
      "          -2.4986e-01,  5.1758e-02,  1.5646e-01, -4.3584e-01,  5.6361e-01,\n",
      "          -3.8657e-01,  4.2325e-03,  4.8502e-02, -1.2308e-01,  8.6264e-02,\n",
      "          -1.1205e-01,  2.5471e-01, -1.4605e-01, -5.0357e-01,  1.2837e-01,\n",
      "           3.1890e-01, -1.5304e-01,  6.0172e-02, -3.0492e-01, -1.9983e-01,\n",
      "           3.8475e-01, -2.5990e-01, -1.9658e-02,  3.1303e-01,  7.1738e-01,\n",
      "           6.8834e-02,  9.2168e-02, -6.0494e-01, -4.4638e-01,  2.1839e-02,\n",
      "           7.6458e-02, -7.5754e-02,  1.3711e-01,  2.3320e-01,  2.9356e-01,\n",
      "          -1.1466e-01,  2.0215e-01, -6.5827e-02,  3.9208e-01, -5.1298e-02,\n",
      "           1.8280e-01, -1.0459e-02,  3.4793e-03, -2.3455e-01, -3.3730e-01,\n",
      "          -7.2544e-01,  5.0401e-01, -3.1658e-02, -2.6494e-01, -5.1410e-01,\n",
      "          -3.0239e-01,  6.2284e-01,  4.4882e-01, -2.3300e-02,  3.8708e-01,\n",
      "          -1.0759e-01, -1.1635e-01, -9.4939e-01,  6.2494e-01,  2.3814e-01,\n",
      "          -2.2261e-01,  3.9366e-01,  8.0495e-02,  8.8363e-02,  2.6852e-01,\n",
      "           4.0673e-01,  4.6187e-01, -5.8302e-01,  6.6265e-03, -1.0574e-01,\n",
      "          -3.7466e-01,  5.8016e-01,  1.1432e-01,  5.9900e-01,  2.4047e-01,\n",
      "           1.1139e-01, -2.7014e-02, -1.4646e-01, -2.3961e-01, -6.3790e-02,\n",
      "           2.9569e-01, -4.3878e-01,  2.8832e-01, -2.3296e-01,  5.1893e-01,\n",
      "          -2.3136e-01, -2.2244e-01,  3.4603e-01,  1.2679e-01,  2.7953e-01,\n",
      "          -2.8354e-01,  2.8744e-01,  2.0245e-01,  2.1818e-01, -4.5833e-01,\n",
      "           2.5191e-01, -6.5259e-02, -2.8307e-02,  8.8991e-02,  1.4545e-01,\n",
      "          -2.2760e-01, -3.5215e-01,  2.9647e-02, -4.5976e-02,  3.6866e-01,\n",
      "          -2.4624e-01, -3.9849e-02, -3.2855e-03, -3.5273e-01,  1.8815e-01,\n",
      "          -2.3960e-01,  3.9571e-01,  2.0072e-01,  9.1031e-02, -7.5674e-02,\n",
      "          -3.1302e-02, -3.1262e-02, -5.2754e-02,  7.5867e-02,  2.3876e-01,\n",
      "           4.0375e-02, -4.6622e-01, -3.9395e-01,  3.6424e-01, -1.6060e-01,\n",
      "           6.4548e-02,  3.7856e-01,  3.5098e-01,  8.4058e-02, -2.7102e-01,\n",
      "           3.7121e-03, -6.3147e-02,  8.0141e-02,  1.8381e-01, -3.3411e-01,\n",
      "          -1.9308e-01, -2.9431e-01,  4.2819e-01,  1.6680e-01, -5.9038e-01,\n",
      "          -3.7005e-01, -1.5277e-01, -9.9374e-02, -2.9181e-01,  7.9388e-01,\n",
      "          -4.0738e-02, -3.5941e-01, -8.9296e-02, -4.9869e-01,  1.5085e-01,\n",
      "          -5.4987e-01, -2.1642e-01,  2.0697e-02,  2.1815e-01, -7.7988e-02,\n",
      "           7.7029e-01, -1.7278e-01,  2.0854e-01,  1.0269e-01, -6.4018e-01,\n",
      "          -6.0683e-01, -8.0977e-01,  4.5154e-02, -1.6796e-01,  5.7937e-01,\n",
      "           4.4507e-01, -8.2655e-02, -2.3316e-02,  3.8361e-01, -1.5765e-01,\n",
      "          -3.7593e-01, -4.3774e-01,  4.3690e-01,  1.1518e-01, -3.4511e-01,\n",
      "          -6.5454e-02]],\n",
      "\n",
      "        [[ 2.7830e-01,  5.9770e-01,  4.7459e-01,  3.2059e-01, -2.7118e-01,\n",
      "           4.6900e-02,  3.1523e-01,  5.1883e-02, -1.6557e-01,  4.4385e-01,\n",
      "           5.9610e-01, -2.6205e-01,  3.0450e-01, -4.6587e-01, -2.0363e-02,\n",
      "          -5.2134e-01,  4.7819e-01, -2.7045e-01, -2.0030e-01,  4.0223e-02,\n",
      "           1.2772e-01,  1.3791e-01, -6.1507e-02, -3.2361e-01, -3.0487e-01,\n",
      "           3.7572e-01,  5.7014e-01, -2.4166e-01, -1.8710e-01, -2.4069e-01,\n",
      "           1.7636e-01,  2.0783e-01,  2.8978e-01,  5.3737e-01, -2.6058e-02,\n",
      "           3.7425e-02, -7.8471e-02,  1.8238e-01, -9.3808e-01, -5.1273e-03,\n",
      "           1.8043e-01, -3.1102e-01, -6.0912e-01,  5.2577e-02, -4.6751e-01,\n",
      "           2.9223e-01,  1.5078e-01, -1.1142e-01, -1.7800e-01, -7.4129e-02,\n",
      "           4.1346e-02,  1.1840e-01,  3.1285e-01,  2.0200e-02, -3.8941e-01,\n",
      "          -4.4079e-01,  4.8638e-01, -6.1309e-02, -7.0709e-01, -3.4666e-01,\n",
      "          -4.1255e-01,  1.2179e-01, -4.9141e-02, -2.1352e-01,  2.5342e-01,\n",
      "           3.1456e-01,  4.1286e-01, -2.8767e-01,  1.1364e+00,  9.5805e-03,\n",
      "           5.9182e-01, -4.3912e-01, -4.4083e-01, -1.6485e-01,  3.7820e-01,\n",
      "           7.2436e-01, -5.5750e-02,  3.4742e-01,  2.8247e-01,  2.8690e-01,\n",
      "          -5.0493e-02, -1.8422e-01, -7.8593e-02, -3.9696e-01,  4.3694e-01,\n",
      "          -1.2263e+00,  1.6336e-01,  4.0669e-01, -4.9801e-01,  1.2184e-01,\n",
      "           7.4561e-01,  5.7358e-01,  1.9280e-01, -4.2037e-01,  9.6338e-02,\n",
      "           7.1715e-01,  3.4546e-01, -1.1251e-01,  3.1726e-02, -4.2019e-01,\n",
      "           3.0872e-01, -2.3446e-02,  1.0144e-01,  6.3341e-01,  4.1943e-01,\n",
      "          -2.5350e-01,  4.5609e-01, -5.2293e-01, -2.8788e-01,  3.7245e-01,\n",
      "          -6.4503e-02, -5.2664e-01, -1.2499e-01,  2.1754e-01, -5.2414e-02,\n",
      "           3.9511e-02,  7.0375e-01, -3.6490e-01,  7.4871e-01, -3.2946e-01,\n",
      "          -4.0429e-03, -2.4869e-01, -2.7334e-01, -2.4336e-01, -3.5205e-01,\n",
      "          -5.5892e-01,  4.5414e-01,  2.4998e-01, -1.4397e-02, -5.3049e-01,\n",
      "           1.6433e-01,  4.3741e-01,  3.5616e-01,  3.8613e-01, -1.0019e-01,\n",
      "           2.1217e-03, -6.3828e-01, -4.0974e-01,  7.7105e-01,  3.7086e-01,\n",
      "          -4.5261e-01,  1.5857e-01, -2.6946e-01, -1.3503e-01,  4.8412e-01,\n",
      "           2.0445e-01,  5.3315e-01, -1.1960e-01, -6.6247e-01, -1.8365e-01,\n",
      "          -2.7428e-01,  1.1341e+00, -2.7842e-01,  2.8601e-01,  7.4305e-01,\n",
      "          -4.5107e-01, -3.3828e-01, -1.8653e-01,  3.0931e-02, -1.4156e-02,\n",
      "          -8.5117e-02, -4.5854e-01,  7.9287e-01, -3.4933e-01,  2.6967e-02,\n",
      "           6.4408e-02, -4.0335e-01,  2.8112e-01, -1.9113e-01,  1.3288e-01,\n",
      "           5.2845e-02,  1.2107e-01,  6.0234e-02,  7.1477e-01, -4.1514e-01,\n",
      "          -8.0090e-02, -5.8279e-02, -2.3144e-01,  3.6371e-01,  2.2659e-01,\n",
      "          -1.0356e-01, -6.0011e-01,  2.3836e-01, -3.2725e-01,  1.3900e-01,\n",
      "          -1.2825e-01,  2.6905e-01, -3.5943e-01, -4.1055e-01, -6.9638e-02,\n",
      "          -1.9805e-01, -4.0654e-01,  3.8833e-01,  6.4839e-02,  9.3675e-02,\n",
      "          -2.2086e-01,  1.0489e-01,  1.4551e-02, -9.4717e-02,  3.1475e-01,\n",
      "           1.5980e-01, -5.9818e-01, -2.5594e-01,  3.9546e-01, -1.6731e-01,\n",
      "           2.0612e-01,  4.6774e-01, -2.3862e-01,  3.1528e-01, -6.3455e-02,\n",
      "           2.4621e-01, -2.2389e-01,  2.3389e-01,  7.5246e-02, -1.2209e-01,\n",
      "          -5.7624e-02, -3.9415e-01,  1.0842e+00, -6.2524e-02, -7.3146e-01,\n",
      "          -7.1254e-01, -1.9202e-01,  3.6810e-01, -1.8203e-01,  7.2884e-01,\n",
      "          -5.7272e-01, -5.8924e-02, -2.6216e-02, -1.7960e-01, -2.2342e-02,\n",
      "          -3.3231e-01,  4.3109e-01,  1.0242e-01,  5.0900e-02, -3.2849e-01,\n",
      "           7.9580e-01,  4.1611e-01,  2.9184e-01,  4.6281e-01, -5.9336e-01,\n",
      "          -1.4921e-01, -1.5291e-01,  1.4200e-01, -3.4664e-01,  1.5383e-01,\n",
      "           1.0130e-01, -1.7650e-01, -5.9191e-02, -2.3306e-01, -2.1638e-01,\n",
      "          -4.0020e-01,  1.0985e-01,  4.6938e-01,  2.1810e-01,  3.2453e-01,\n",
      "          -5.0564e-02]],\n",
      "\n",
      "        [[ 2.1540e-01,  3.2102e-01,  2.6404e-01,  9.0247e-02, -7.6837e-03,\n",
      "          -1.6140e-01,  2.9299e-01, -4.5516e-01, -3.9856e-01,  5.6224e-01,\n",
      "           2.5744e-01, -1.5084e-01, -2.1693e-01, -2.5489e-02, -1.4589e-01,\n",
      "          -2.6469e-01,  1.5648e-01, -2.9623e-02, -4.2975e-01,  3.3836e-01,\n",
      "           5.4530e-02,  1.2128e-01,  1.8598e-01, -2.7569e-01, -1.6482e-01,\n",
      "           8.9016e-03,  1.5621e-01, -7.7822e-02, -4.3648e-01, -2.3238e-01,\n",
      "           3.2631e-01,  9.0581e-02,  3.8661e-01,  4.8679e-01,  3.0502e-02,\n",
      "           2.1006e-01, -2.3570e-01, -1.8760e-02, -6.8117e-01,  7.1145e-02,\n",
      "           3.3094e-01,  9.0138e-02, -3.7802e-01, -4.0344e-01, -1.9533e-01,\n",
      "           3.4360e-01,  1.3201e-01,  1.0499e-01, -1.9168e-01,  1.0717e-01,\n",
      "           6.5187e-01,  4.3703e-01, -1.0166e-01,  2.7717e-01, -3.3142e-02,\n",
      "          -4.1511e-01, -1.9290e-02, -1.2688e-01,  6.7052e-02, -6.4181e-03,\n",
      "          -2.9276e-01, -2.1687e-01, -5.7740e-02, -1.6237e-01,  2.4224e-01,\n",
      "           1.4074e-01,  3.1716e-01, -4.8024e-01,  2.7691e-01,  3.3539e-01,\n",
      "           3.2639e-01, -1.6640e-01, -2.3601e-01,  4.0050e-01,  5.0334e-01,\n",
      "           2.5483e-01, -1.1064e-01,  3.8142e-01, -1.3477e-01, -4.4867e-02,\n",
      "          -1.6056e-01, -2.9009e-01, -1.3766e-01, -9.3311e-02,  6.1456e-01,\n",
      "          -6.6721e-01,  7.0165e-02, -3.6730e-02,  1.4274e-02, -8.2764e-02,\n",
      "           8.3313e-02,  1.4566e-01,  2.1106e-01, -2.1744e-01,  2.3620e-01,\n",
      "           5.1037e-01,  1.2769e-01, -2.4724e-01,  4.3373e-02, -4.2694e-01,\n",
      "           1.3567e-01, -2.9519e-01,  4.6533e-03,  2.9849e-01,  1.4111e-01,\n",
      "          -3.2911e-02, -3.1558e-01, -5.3818e-01, -1.7478e-01, -8.1812e-02,\n",
      "           3.6999e-01, -3.7321e-02,  1.9690e-01,  1.1684e-01, -1.8747e-01,\n",
      "           1.7470e-01,  1.3939e-01, -1.7802e-01,  5.2151e-03, -5.5488e-01,\n",
      "           3.8395e-02, -5.3283e-01, -2.5757e-01, -1.8692e-01, -3.5922e-01,\n",
      "          -4.1308e-01,  2.0563e-01, -3.2655e-01, -1.1934e-01, -3.0354e-01,\n",
      "          -1.9894e-01,  1.5439e-01,  2.0062e-01,  1.6798e-01, -2.8702e-01,\n",
      "          -1.9050e-01, -2.1603e-01, -4.8204e-01,  7.0485e-01,  4.2205e-01,\n",
      "          -1.1282e-01, -8.1081e-02, -7.7219e-02,  3.6236e-03,  1.7920e-01,\n",
      "           3.4055e-01,  1.4055e-01, -4.1303e-01, -2.6413e-01,  3.6767e-02,\n",
      "          -1.5294e-01,  2.6837e-01, -4.1070e-02,  8.9287e-02,  2.7556e-01,\n",
      "          -1.2932e-01, -1.7932e-01, -1.7886e-01,  1.8826e-02,  7.7835e-02,\n",
      "           4.1870e-01, -3.3064e-01,  5.6354e-01, -5.5723e-01,  5.0645e-01,\n",
      "          -2.2268e-01, -3.8726e-01,  2.0088e-01, -2.4178e-02,  9.5835e-02,\n",
      "          -1.1135e-01,  2.7045e-01,  1.7984e-01,  3.0721e-01, -5.1005e-01,\n",
      "          -7.9306e-02, -1.3113e-01, -4.0540e-01, -4.6944e-02,  1.9754e-01,\n",
      "          -4.5133e-01, -1.8684e-01,  1.3871e-01, -4.0192e-01,  2.5598e-01,\n",
      "           6.3874e-02,  2.5218e-02, -2.9897e-01, -7.8918e-02, -9.4724e-02,\n",
      "          -4.8403e-01,  5.4651e-02, -1.0102e-01,  1.3725e-01, -1.2525e-01,\n",
      "          -2.2094e-01, -8.2406e-02, -4.3353e-02, -4.2160e-02, -1.6859e-01,\n",
      "           1.7022e-01, -2.5829e-01, -3.3489e-01,  2.6581e-01, -5.3259e-02,\n",
      "           5.0252e-01,  3.9208e-01,  2.2038e-01,  3.1816e-01,  1.8655e-01,\n",
      "           3.6178e-01, -4.6165e-02,  2.7977e-01,  3.2720e-01, -1.3403e-01,\n",
      "           6.1025e-02, -9.8955e-02,  5.8766e-01,  5.7344e-02, -4.1520e-01,\n",
      "          -3.3389e-01, -2.7823e-01, -6.5831e-02, -1.9252e-01,  5.3581e-01,\n",
      "          -3.3284e-01, -3.5431e-02, -2.1771e-02,  1.9223e-01, -1.4499e-01,\n",
      "          -4.0693e-01, -9.7481e-02, -1.0512e-01, -2.0861e-02,  2.3927e-02,\n",
      "           3.3741e-01,  2.7100e-01,  1.5169e-01,  3.7943e-02, -7.8944e-01,\n",
      "          -3.2011e-01, -2.7066e-01, -1.4997e-01, -4.7634e-01,  1.9655e-01,\n",
      "           1.1609e-01, -4.3424e-01, -7.3741e-02,  1.5546e-01,  8.2381e-02,\n",
      "           1.4600e-01,  7.6365e-02,  1.8451e-01,  2.5309e-01, -8.8252e-02,\n",
      "           1.8649e-01]],\n",
      "\n",
      "        [[ 1.7512e-01,  1.8898e-02,  4.8839e-01,  1.6433e-01, -1.5254e-01,\n",
      "           5.8914e-02,  4.7173e-01, -2.6325e-01, -4.6751e-01,  5.4605e-01,\n",
      "           5.9671e-01,  4.3743e-01, -1.9249e-02, -4.9346e-01, -2.7758e-02,\n",
      "          -4.1398e-01,  2.1173e-01, -1.2578e-01,  5.0728e-02,  1.8759e-01,\n",
      "          -5.8148e-02, -6.3575e-02,  1.1926e-01, -4.0487e-01, -1.2652e-02,\n",
      "           4.9104e-01,  3.7912e-01, -6.7100e-02, -9.3388e-02, -1.7939e-01,\n",
      "           3.1057e-01,  1.4229e-01,  3.3673e-01,  4.6882e-01, -8.3259e-02,\n",
      "           2.9152e-01,  2.8544e-02,  5.8496e-02, -6.0155e-01,  2.0066e-01,\n",
      "           1.7710e-01, -2.0029e-01, -1.7098e-01, -4.9266e-01, -4.5200e-01,\n",
      "           4.0484e-01,  3.8831e-01, -1.3371e-01, -2.3565e-01, -3.4412e-01,\n",
      "           4.7389e-01,  2.6338e-01,  2.2353e-01,  1.2120e-01, -6.2378e-02,\n",
      "          -2.8814e-01,  6.1378e-01,  1.4602e-01,  1.5500e-01, -2.2329e-01,\n",
      "          -7.1117e-01,  3.3673e-01, -6.2068e-01, -2.0164e-01, -1.8266e-01,\n",
      "           2.6967e-01,  3.3241e-01,  5.4242e-02,  4.0353e-01, -4.1730e-01,\n",
      "           4.2961e-01, -4.3984e-01,  5.1117e-02,  2.4414e-01,  1.8933e-01,\n",
      "           3.1420e-01, -9.9389e-02,  3.4778e-02, -6.3595e-04,  3.6004e-02,\n",
      "          -1.4613e-01, -2.4323e-01, -1.5317e-01, -1.4559e-01,  2.5285e-01,\n",
      "          -9.1157e-01,  7.4123e-02,  4.3648e-01, -6.2412e-03, -4.2377e-02,\n",
      "           7.9575e-01,  2.3094e-01,  4.7393e-01, -2.7359e-01,  5.3904e-01,\n",
      "           5.4208e-01,  3.9483e-01, -2.7244e-01,  3.2014e-01, -3.3482e-01,\n",
      "           6.3056e-01, -9.5692e-02,  3.0136e-01,  2.8343e-01,  5.7409e-01,\n",
      "           1.5308e-01, -5.3745e-03, -2.5235e-01, -4.5492e-01, -8.4647e-02,\n",
      "          -4.7025e-02, -2.9918e-01,  6.3403e-02,  1.5294e-01,  1.9934e-01,\n",
      "           3.5136e-01,  4.6939e-01, -4.3674e-01,  1.7388e-01, -1.3983e-01,\n",
      "           8.8059e-02, -1.0776e-01, -1.9341e-01,  1.3863e-01, -8.3853e-02,\n",
      "          -4.8275e-01,  3.8941e-01,  3.5043e-01,  1.3238e-01, -4.0969e-01,\n",
      "           4.1145e-02,  6.1857e-01,  3.6052e-01,  7.7173e-02, -5.9774e-02,\n",
      "          -1.9304e-01, -6.2695e-02, -5.0551e-01,  4.8363e-01,  3.9604e-01,\n",
      "          -2.7909e-01, -7.4583e-02, -2.7511e-01, -4.5784e-02,  1.0533e-01,\n",
      "           5.5868e-01,  4.6914e-01, -2.1393e-01, -5.1188e-01,  2.3933e-01,\n",
      "           1.0720e-01,  5.3063e-01,  1.0957e-02,  8.0692e-02,  1.6050e-01,\n",
      "          -5.8779e-02, -7.5950e-02,  7.9925e-02,  2.3579e-01,  1.9602e-01,\n",
      "           1.3791e-01, -2.8907e-01,  8.7783e-01, -9.6084e-02,  2.5242e-01,\n",
      "           2.4720e-01, -3.2086e-01, -5.6966e-02,  5.1978e-03,  2.4912e-01,\n",
      "          -7.2770e-02,  2.2924e-01,  1.2092e-02,  3.9733e-01, -6.5727e-01,\n",
      "          -3.3193e-01, -5.2217e-03,  8.8511e-03,  6.9495e-01, -1.0797e-01,\n",
      "          -1.1657e-01,  5.0962e-02,  3.1739e-01, -4.6492e-01,  2.8207e-01,\n",
      "          -1.4626e-01, -8.5407e-02, -4.0611e-03, -3.8512e-01, -3.3227e-01,\n",
      "          -1.8319e-01, -2.4410e-01,  4.3059e-01,  1.0124e-01,  3.2987e-01,\n",
      "           2.4550e-01, -2.4793e-02, -1.3055e-01,  3.9035e-02,  4.0054e-01,\n",
      "           2.4673e-01, -2.9818e-01, -3.8804e-01,  5.5155e-01,  4.9717e-02,\n",
      "           4.3611e-01,  5.6989e-01,  7.4845e-02,  4.1333e-01, -3.4701e-01,\n",
      "          -8.7897e-02,  6.9097e-02,  5.6038e-02,  1.9545e-01, -2.7304e-01,\n",
      "           1.3195e-01,  1.2622e-01,  5.5757e-01,  2.9549e-01, -4.9047e-01,\n",
      "          -4.1210e-01, -1.5344e-01,  2.3543e-01, -4.6959e-01,  3.4838e-01,\n",
      "          -1.6022e-01,  2.9122e-01,  2.9992e-01, -1.7408e-01,  2.9037e-01,\n",
      "          -2.2522e-01, -3.5514e-02,  8.4405e-03,  2.9851e-01, -2.1216e-01,\n",
      "           6.9622e-01,  2.3994e-01,  2.3206e-01,  1.4799e-01, -8.2484e-01,\n",
      "          -2.7673e-01, -3.0541e-01,  2.7697e-01, -5.7929e-01,  5.6789e-01,\n",
      "           4.6877e-02, -2.0583e-02, -5.3642e-02, -1.8680e-01,  2.1157e-01,\n",
      "          -3.9932e-01,  8.3750e-02,  8.0414e-01, -1.1668e-01, -1.3559e-01,\n",
      "           1.0397e-01]],\n",
      "\n",
      "        [[ 1.1911e-01, -1.2342e-02,  2.4716e-01, -1.6819e-02, -1.2663e-01,\n",
      "           3.3541e-01,  5.6019e-01, -2.2004e-01,  5.2378e-02,  7.6064e-01,\n",
      "           1.3371e-01,  8.0257e-02, -9.9715e-03, -1.8751e-01,  2.7088e-02,\n",
      "          -3.5931e-01,  1.8992e-01,  1.3585e-01, -3.1335e-01, -1.6705e-01,\n",
      "           3.0054e-01, -6.1937e-02,  3.9658e-01,  9.5601e-03,  4.1622e-01,\n",
      "           1.6666e-01,  5.6721e-01, -5.9558e-01, -8.1242e-01, -5.0557e-01,\n",
      "           4.3195e-01,  3.4568e-01,  2.6077e-01,  9.6867e-01,  2.6979e-01,\n",
      "          -2.3928e-02,  1.6294e-01, -2.0511e-01, -6.1646e-01,  4.4660e-02,\n",
      "          -1.8338e-01, -7.2377e-02, -4.7436e-01, -2.9905e-01, -5.7605e-02,\n",
      "           2.4411e-01,  6.3080e-01, -1.1175e-01, -8.8767e-02, -3.3440e-02,\n",
      "           4.1268e-01,  2.3149e-01, -3.8693e-02,  5.6717e-02, -3.5812e-01,\n",
      "           6.0038e-02,  3.2124e-01,  1.6394e-01, -1.9718e-01, -1.0762e-01,\n",
      "          -4.8072e-01, -5.2394e-02, -1.4390e-01,  1.9757e-02,  2.2443e-01,\n",
      "           8.6678e-01,  1.8927e-01, -2.1019e-01,  4.4070e-01,  5.5229e-01,\n",
      "           5.3633e-01, -2.0315e-01, -6.0320e-02,  2.4899e-01,  7.1932e-01,\n",
      "           3.8618e-01, -7.5284e-02,  4.0355e-01, -3.1258e-01, -1.5134e-01,\n",
      "          -1.6737e-01, -1.9048e-02, -2.1453e-01, -1.5304e-01,  4.9294e-01,\n",
      "          -8.5380e-01, -1.5565e-02,  1.5081e-01, -1.2475e-02,  1.8273e-02,\n",
      "           3.0641e-01,  9.4483e-02,  1.5797e-02, -5.5543e-01,  9.7649e-02,\n",
      "          -1.2171e-01,  7.1311e-02,  1.5938e-01,  2.4095e-01, -1.6388e-01,\n",
      "           6.8461e-01, -2.0285e-01,  9.9162e-02,  1.9690e-01,  1.7888e-01,\n",
      "          -1.1929e-01,  3.4337e-01, -3.3043e-01, -2.2902e-01,  6.5707e-02,\n",
      "           3.1975e-01,  3.8276e-02, -4.7253e-02, -7.4518e-02, -8.3143e-02,\n",
      "           1.3671e-01,  6.8245e-01, -1.5139e-01,  3.3575e-01, -2.7296e-01,\n",
      "          -1.2052e-01, -1.1782e-01, -1.9981e-01, -5.4102e-03, -5.3520e-01,\n",
      "          -5.7398e-01, -8.2836e-02, -1.6752e-01,  1.0267e-01, -4.0825e-01,\n",
      "           1.4543e-01,  1.0181e-02,  3.4048e-01,  1.4266e-01, -4.1880e-02,\n",
      "          -1.6082e-01, -3.8792e-01, -8.9735e-01,  7.6885e-01,  5.1602e-01,\n",
      "          -4.1050e-02,  7.9011e-02,  1.6403e-01,  2.8430e-01,  3.3245e-01,\n",
      "           5.8879e-01,  2.9607e-01, -1.8782e-01, -4.4395e-01,  1.7548e-01,\n",
      "          -4.3930e-01,  4.8763e-01,  6.3340e-02,  1.0336e-01,  4.8057e-02,\n",
      "           1.1758e-01, -2.4251e-01,  9.3457e-02,  2.1221e-01,  7.0234e-02,\n",
      "           3.0362e-01, -1.7817e-01,  4.3454e-01, -1.1158e-01, -1.0157e-02,\n",
      "          -2.1991e-01, -3.3599e-01,  2.2945e-01, -1.1113e-01,  8.0440e-02,\n",
      "          -3.4117e-01, -2.5867e-01,  1.6257e-01,  6.9767e-01, -7.2491e-01,\n",
      "          -1.8565e-01,  2.8272e-01, -4.3989e-01, -9.9144e-02,  4.5174e-02,\n",
      "          -2.6355e-01, -2.9222e-01,  2.9951e-01, -4.2358e-01,  1.1238e-01,\n",
      "          -2.2019e-02,  2.1310e-01, -1.8539e-01, -2.4271e-01, -1.1969e-01,\n",
      "          -1.0138e-01, -2.2214e-01, -1.6554e-01,  1.2701e-01,  8.7763e-03,\n",
      "          -3.4746e-02,  2.3362e-01,  8.1621e-02, -5.7078e-01,  1.1254e-01,\n",
      "           3.9573e-01, -4.6560e-01,  3.7665e-02,  5.7041e-02, -1.8580e-01,\n",
      "           3.5977e-01, -1.1494e-01,  3.4977e-01,  3.7275e-01, -5.1431e-02,\n",
      "           2.4258e-02, -1.0172e-01,  2.0886e-01,  7.0086e-01, -7.3012e-01,\n",
      "          -6.3623e-02, -2.6016e-01,  3.4429e-01, -1.2936e-01, -8.0564e-01,\n",
      "          -2.9275e-01, -2.1468e-01, -2.1877e-01, -1.7741e-01,  7.0186e-01,\n",
      "          -1.7314e-01, -2.1608e-01,  1.4621e-01,  6.9288e-02, -4.5018e-01,\n",
      "          -3.1463e-01,  1.6515e-01, -1.6399e-01,  1.2696e-01, -1.4199e-01,\n",
      "           3.5851e-01,  6.1733e-02,  3.4781e-01,  5.3868e-02, -6.6008e-01,\n",
      "          -5.1021e-01, -2.0093e-01, -7.9609e-02, -2.8551e-01,  6.9571e-02,\n",
      "           4.1940e-01, -1.7457e-01,  9.3678e-02, -1.0343e-01, -7.5770e-02,\n",
      "          -1.8928e-01,  1.3226e-01,  1.6359e-01,  4.1931e-01, -7.0911e-02,\n",
      "           6.2369e-02]],\n",
      "\n",
      "        [[ 7.2822e-02,  6.4172e-01, -2.3440e-01, -4.6111e-01, -2.9480e-01,\n",
      "           4.6824e-01, -1.3211e-01, -4.9181e-01, -3.7419e-01,  7.3750e-01,\n",
      "           9.4842e-02, -2.1472e-02,  2.4571e-02, -4.0678e-01,  2.0001e-01,\n",
      "          -3.5126e-01,  7.4110e-02, -1.5762e-01,  8.5007e-02, -4.5972e-02,\n",
      "           2.2202e-01, -3.8020e-01, -3.3434e-01,  1.6630e-01,  3.1048e-01,\n",
      "          -2.8291e-01,  1.3701e-01, -3.5314e-01, -6.4815e-01,  6.1082e-02,\n",
      "          -2.8438e-01, -1.9057e-01, -1.9229e-01,  6.1498e-01,  4.9224e-01,\n",
      "          -4.9377e-02, -5.5966e-02, -1.7484e-01, -6.4809e-01,  1.1267e-01,\n",
      "          -2.5325e-01, -2.9996e-01, -1.0916e-01, -7.7304e-01, -6.5819e-02,\n",
      "           3.8100e-01,  3.6938e-01, -2.3114e-01,  5.0852e-02, -1.9180e-01,\n",
      "          -7.4446e-05,  3.4147e-01,  4.0398e-01, -2.1805e-02, -8.8105e-01,\n",
      "          -1.0531e-01,  8.6122e-01, -2.2151e-01,  1.2324e-02, -2.1821e-01,\n",
      "          -4.5840e-01,  2.0978e-01, -1.2859e-01,  4.1716e-01,  7.4667e-01,\n",
      "           1.3844e-01,  3.8252e-01,  2.2862e-01,  6.3251e-01,  5.6204e-02,\n",
      "           3.4006e-01, -3.1764e-01,  5.5985e-01,  3.4701e-01,  4.5640e-03,\n",
      "           3.0284e-01, -2.2877e-01,  7.4976e-01, -3.7124e-01,  9.4743e-02,\n",
      "          -4.6484e-01, -4.2173e-01,  2.7944e-01,  2.7762e-01,  1.6353e-01,\n",
      "          -6.5028e-01,  4.0736e-01, -1.2647e-01, -4.9600e-01, -1.4136e-01,\n",
      "           2.5595e-01,  3.3265e-01, -3.0573e-01, -5.2263e-02, -4.0789e-02,\n",
      "           5.8596e-02,  1.4465e-03, -1.5596e-01, -4.0607e-01,  2.8538e-01,\n",
      "           7.2052e-01, -1.0613e-01, -3.0676e-01, -7.5449e-02,  7.6827e-01,\n",
      "          -7.7206e-02,  2.4580e-01, -8.3663e-01, -2.4597e-01, -2.0261e-01,\n",
      "          -1.1366e-01,  2.0057e-01, -3.1271e-01,  2.8425e-01, -2.3159e-02,\n",
      "           1.3082e-01,  4.7999e-01, -2.7173e-01,  3.9751e-01, -2.6479e-01,\n",
      "          -3.2659e-01,  1.3300e-01, -2.0780e-01, -5.8078e-02, -3.9458e-01,\n",
      "          -3.2117e-01,  6.1649e-01, -3.0698e-01, -1.4544e-01, -3.6520e-01,\n",
      "           1.0100e-01, -3.8983e-02,  4.7904e-02,  8.9041e-02,  2.1434e-01,\n",
      "          -1.4079e-01, -7.8056e-01, -8.9341e-01,  7.1617e-01, -2.9393e-01,\n",
      "           8.2485e-02,  2.9640e-01, -2.4669e-01, -2.5856e-01,  2.4864e-01,\n",
      "          -2.9357e-01,  4.2424e-01, -3.5013e-02, -1.2894e-01,  8.5069e-03,\n",
      "          -4.5307e-01,  7.6170e-01,  1.2651e-01, -2.1775e-03, -2.1854e-01,\n",
      "           1.3169e-01, -5.0438e-01, -1.8346e-01, -1.7588e-01,  2.3147e-02,\n",
      "          -3.4707e-02, -4.1759e-01,  8.6528e-01, -1.2476e-01, -2.9108e-01,\n",
      "           3.5127e-01, -1.4207e-01,  3.6151e-01,  2.7984e-01,  1.2643e-01,\n",
      "          -3.0276e-01, -3.4926e-01, -3.3320e-02,  1.8567e-01, -5.8097e-01,\n",
      "           6.9159e-02,  5.7814e-01, -2.2404e-01, -3.7370e-02, -3.0433e-01,\n",
      "          -6.2634e-01, -6.1575e-01,  4.2210e-01, -1.0142e-01,  5.3975e-01,\n",
      "          -1.4132e-01, -7.0632e-01,  1.8463e-01, -2.2811e-01,  2.2977e-01,\n",
      "          -6.2256e-01, -2.4718e-01, -9.6975e-02,  5.2096e-01,  3.4748e-01,\n",
      "           2.0123e-01, -4.1068e-01, -2.0974e-01, -2.9076e-02,  1.5175e-01,\n",
      "           3.8988e-03, -3.8424e-01, -2.0595e-01, -4.0764e-03, -1.7862e-02,\n",
      "           7.1338e-01,  1.7361e-01, -6.4107e-02, -1.2817e-01,  5.2044e-02,\n",
      "           9.6095e-02, -2.9485e-01, -1.1437e-01,  2.8387e-02, -2.2237e-01,\n",
      "          -3.7714e-02, -4.5623e-01,  7.9933e-01,  2.1317e-01, -3.0558e-01,\n",
      "          -4.1594e-01, -3.8548e-01,  2.4833e-01, -1.2701e-01,  3.1610e-01,\n",
      "           1.4272e-03,  2.4658e-01, -1.2467e-01, -4.6252e-01, -4.6221e-01,\n",
      "           1.5418e-01, -4.2499e-01, -1.8981e-01, -1.4697e-01, -1.3527e-01,\n",
      "           2.8863e-01,  1.1126e-01,  5.2848e-01,  6.0401e-01, -9.2615e-02,\n",
      "          -6.7984e-01, -9.7047e-01, -2.8737e-01, -1.7248e-01,  7.8156e-01,\n",
      "           4.0409e-01, -2.3039e-01,  1.9981e-01, -1.9078e-02,  1.4180e-01,\n",
      "          -1.7267e-01, -1.1357e-01,  4.6516e-01, -6.0353e-02,  1.1620e-01,\n",
      "          -2.9354e-02]],\n",
      "\n",
      "        [[ 1.4888e-01,  1.5345e-01,  4.6901e-01, -1.6560e-01, -3.1011e-01,\n",
      "           1.1934e-01,  4.1603e-01, -1.1986e-01,  8.5612e-02,  2.6400e-01,\n",
      "           4.5801e-01,  7.0230e-02,  2.1830e-01, -1.4043e-01, -8.7342e-02,\n",
      "          -6.9695e-01,  5.7002e-01,  3.8031e-01, -3.7969e-01, -7.4232e-03,\n",
      "           4.2964e-02,  3.1190e-01,  5.0590e-02, -1.7935e-01, -1.4973e-01,\n",
      "           3.7769e-01,  2.1541e-01, -7.6551e-03, -3.7540e-01, -2.5662e-01,\n",
      "          -4.7612e-02,  4.6014e-01,  7.7826e-02,  7.2359e-01,  1.2589e-01,\n",
      "          -2.6351e-01,  1.8513e-01, -4.7541e-02, -6.5549e-01,  3.1752e-02,\n",
      "          -2.1299e-02, -1.8096e-01, -2.8199e-01, -1.0439e-01, -5.5933e-01,\n",
      "           7.3157e-01,  4.8840e-01, -3.1227e-03, -2.0708e-01, -2.8940e-01,\n",
      "           7.3080e-01,  4.0953e-02,  5.7311e-01, -3.9314e-01, -1.5048e-01,\n",
      "          -4.7087e-01,  6.8142e-01, -2.8886e-03, -1.3841e-01, -2.5610e-01,\n",
      "          -3.9474e-01, -2.5300e-01, -3.0987e-01,  6.7313e-03,  6.8829e-01,\n",
      "           6.4017e-01,  7.4383e-01, -1.2808e-01,  7.0075e-01,  4.7100e-02,\n",
      "           6.3754e-01, -2.3744e-01,  2.7643e-01,  1.1912e-01,  2.1366e-01,\n",
      "           1.1157e+00,  2.8710e-02,  4.0985e-01,  1.8894e-01,  4.2683e-02,\n",
      "          -9.7417e-02,  4.5220e-01, -1.7729e-02, -9.1495e-02,  3.8505e-01,\n",
      "          -5.7003e-01,  2.2265e-01,  5.3747e-01, -2.9505e-01,  3.2361e-01,\n",
      "           1.0101e+00,  2.4153e-01, -1.0212e-01, -5.9935e-01,  6.5733e-01,\n",
      "           2.9659e-01,  5.4074e-01, -3.2582e-02,  1.6763e-01, -3.2056e-01,\n",
      "           5.9868e-01, -2.3125e-01,  2.7253e-01,  1.9664e-01,  4.5045e-01,\n",
      "          -1.9125e-01, -6.9219e-02, -3.4109e-01, -2.9079e-01, -4.7302e-01,\n",
      "           7.2888e-01, -8.7853e-02,  3.2869e-01,  2.8668e-01, -7.3755e-02,\n",
      "           1.1923e-01,  2.2956e-01, -4.8459e-01,  5.6762e-01, -5.2089e-01,\n",
      "           1.1182e-01, -3.5029e-01, -2.8475e-01,  2.2253e-01, -4.2731e-01,\n",
      "          -8.1882e-01,  5.8666e-01, -1.4102e-01, -5.8115e-01, -2.0312e-01,\n",
      "           8.3698e-02,  8.2979e-01,  3.8832e-01,  3.0668e-01, -2.0807e-01,\n",
      "          -1.4223e-01, -1.7123e-01, -6.9536e-01,  6.1739e-01,  3.4875e-01,\n",
      "          -1.2475e-01,  4.8580e-02,  5.8108e-02, -9.0691e-02,  5.8527e-01,\n",
      "           9.5189e-01,  9.4827e-01, -3.8697e-01, -4.2159e-01, -4.3830e-01,\n",
      "          -4.7309e-01,  1.1230e+00, -1.7513e-01,  2.3627e-01,  3.8457e-01,\n",
      "          -1.4097e-01,  4.2527e-02,  2.8354e-01, -1.9314e-01,  4.6820e-01,\n",
      "          -3.3766e-01, -7.2153e-01,  1.1389e+00,  8.7912e-02,  4.3668e-02,\n",
      "           3.4567e-02, -4.0843e-01,  1.7920e-01,  9.9102e-02,  4.7798e-01,\n",
      "           2.8361e-01, -1.1993e-01,  1.8260e-01,  8.7571e-01, -8.6788e-01,\n",
      "           2.5768e-01,  7.3308e-02, -2.7760e-01, -9.0986e-02, -1.3598e-01,\n",
      "          -2.7526e-01,  2.2374e-02, -4.5880e-02, -4.9766e-01,  1.8935e-01,\n",
      "          -5.3407e-01, -1.5494e-01, -5.6480e-01, -8.5137e-02, -3.0951e-01,\n",
      "          -2.8566e-01, -4.6501e-01,  5.1351e-01,  5.3235e-01,  1.2894e-01,\n",
      "          -2.1075e-02,  2.7144e-01,  5.0159e-01,  6.0267e-02, -1.2057e-01,\n",
      "           6.7586e-01, -1.1127e-01, -2.6631e-01,  1.6932e-01, -4.4651e-01,\n",
      "           5.3126e-01,  4.5429e-01,  1.0581e-01,  6.6352e-01, -1.8146e-01,\n",
      "           9.8764e-02, -1.4217e-03, -1.0731e-01,  2.0479e-01, -5.8281e-01,\n",
      "          -2.8907e-01, -1.4254e-01,  3.1637e-01, -1.5246e-01, -5.5237e-01,\n",
      "           2.1563e-01, -7.0935e-01,  2.3941e-01, -3.1433e-02,  7.7614e-01,\n",
      "          -1.4720e-01, -1.2110e-01, -2.7849e-02, -6.8445e-01, -1.7930e-01,\n",
      "           1.8952e-01,  3.0569e-01,  8.3601e-03, -2.1932e-01, -8.2336e-02,\n",
      "           5.9460e-01, -1.0470e-01,  5.0498e-01,  1.0365e+00, -8.6343e-01,\n",
      "          -5.9773e-01, -5.3794e-01,  1.1615e-01, -3.3364e-02,  5.4394e-02,\n",
      "           2.5100e-02,  1.3711e-01,  9.2948e-02, -1.4385e-01,  4.0116e-02,\n",
      "          -8.8499e-02,  3.2286e-01,  1.2462e-01,  1.3811e-01, -1.3484e-01,\n",
      "           2.7338e-01]],\n",
      "\n",
      "        [[ 2.0018e-01, -8.5007e-02,  4.5852e-01, -3.3541e-01, -1.6049e-01,\n",
      "           4.2735e-01, -1.4437e-01, -1.6748e-01, -3.0584e-01,  1.7445e-01,\n",
      "           6.3851e-01, -2.3656e-01, -3.2564e-01, -2.5823e-01, -1.1204e-01,\n",
      "           1.9338e-01, -8.2958e-02, -3.5706e-02, -2.4213e-01,  9.3712e-02,\n",
      "           2.5743e-01,  4.3597e-01,  5.1487e-02,  1.0555e-01,  3.6394e-02,\n",
      "          -4.6169e-02,  3.9012e-01, -6.1320e-01, -3.8466e-01, -2.0328e-01,\n",
      "           3.1431e-01,  4.4408e-01,  1.7122e-01,  5.2142e-01,  4.2229e-01,\n",
      "          -2.0672e-01, -2.0414e-01,  1.0840e-01, -3.9513e-01, -2.1821e-02,\n",
      "           2.5201e-02, -1.4273e-01, -1.7095e-01, -2.6268e-01, -2.6343e-01,\n",
      "           1.7750e-01,  7.0946e-02, -2.8560e-02, -1.3280e-01, -6.4638e-02,\n",
      "          -9.4795e-02,  3.5396e-02, -1.5332e-01, -2.1948e-01, -2.3478e-01,\n",
      "          -7.0016e-01,  4.1766e-01,  2.9293e-01,  1.8017e-02,  2.4441e-01,\n",
      "          -2.3213e-01,  6.4013e-02,  1.1116e-01,  1.2445e-01,  1.4133e-01,\n",
      "           2.1762e-01,  1.7381e-01, -5.8503e-03,  4.4625e-01, -6.4456e-02,\n",
      "           5.7853e-01,  1.7843e-01, -2.4431e-01,  3.7750e-01,  3.0168e-01,\n",
      "           2.3476e-01, -6.6977e-02,  3.3063e-01, -4.0618e-01,  1.0722e-01,\n",
      "          -1.7159e-02,  1.6347e-02,  1.0184e-01,  1.8563e-01,  4.1776e-01,\n",
      "          -6.7088e-01,  4.8818e-02,  1.9402e-01, -4.3134e-01,  1.3418e-01,\n",
      "           9.3646e-02, -4.8942e-02,  2.0568e-01, -5.1230e-01,  6.6858e-02,\n",
      "           5.0103e-01,  8.2279e-02, -4.2688e-01, -1.0006e-01, -3.9756e-01,\n",
      "           3.3103e-03, -4.1964e-02,  1.4849e-01,  2.0166e-01,  6.2778e-01,\n",
      "          -2.6187e-01,  2.9238e-01, -6.0082e-01, -2.8757e-01, -1.5889e-01,\n",
      "           3.7486e-01,  9.7252e-02, -1.8195e-01,  3.0597e-02,  1.6033e-01,\n",
      "          -5.6825e-02,  4.0699e-01, -3.0479e-01,  4.9208e-01, -2.5073e-01,\n",
      "          -1.3139e-01, -1.3687e-01,  8.3788e-02, -1.3623e-01, -9.4389e-02,\n",
      "          -2.8593e-01, -1.7770e-02,  1.3186e-01,  7.2955e-02, -2.3462e-01,\n",
      "           9.1399e-02,  6.0875e-01,  7.0834e-01,  2.8495e-01,  2.6062e-01,\n",
      "           8.1697e-02, -2.6531e-01, -2.8796e-01,  2.2738e-01,  6.9316e-02,\n",
      "          -2.4783e-01,  3.0677e-01, -8.2090e-02,  8.2664e-02,  1.1857e-01,\n",
      "          -1.0441e-01,  3.0236e-01, -4.9738e-01, -3.6458e-01, -2.7355e-02,\n",
      "          -1.5012e-01,  1.6495e-01,  7.2285e-02,  2.3990e-01,  2.4370e-01,\n",
      "          -8.4580e-02,  1.4120e-01, -2.2124e-02, -4.2065e-01, -5.8951e-02,\n",
      "           8.1889e-02, -5.2586e-01,  2.6287e-01, -1.9808e-01,  4.0453e-02,\n",
      "           5.6887e-02, -3.6651e-02,  8.8580e-02, -1.1323e-01,  3.3542e-01,\n",
      "          -1.9066e-01,  2.4711e-01,  4.2050e-01, -1.2050e-01, -3.6344e-01,\n",
      "           1.0499e-02,  6.5594e-01,  6.0197e-02, -1.6123e-01,  5.5531e-01,\n",
      "          -2.9752e-01, -3.1783e-01,  1.1457e-01, -9.8685e-02,  4.4946e-01,\n",
      "           1.2442e-01,  2.9033e-01,  3.3878e-01, -3.7925e-01,  1.0156e-01,\n",
      "          -4.1470e-01, -2.7432e-01, -8.5383e-02, -2.7084e-02, -4.1838e-02,\n",
      "          -1.4088e-01, -7.4789e-02,  6.6084e-02,  1.1950e-01,  5.4586e-02,\n",
      "          -8.0869e-03, -5.7488e-01, -1.5077e-01,  1.1845e-01, -2.1128e-01,\n",
      "           5.3727e-01,  2.6104e-01,  1.4969e-01, -2.3036e-01, -3.0346e-01,\n",
      "           6.3015e-01, -4.8537e-02, -3.9415e-01,  5.1587e-01, -8.2009e-02,\n",
      "          -1.3559e-01, -4.3615e-01,  6.4391e-01, -2.4652e-01, -3.0804e-01,\n",
      "           1.2901e-01, -1.8055e-01, -1.2777e-01,  7.7170e-02, -9.8087e-02,\n",
      "          -2.1729e-01,  4.9747e-02,  1.5325e-01, -2.9539e-01, -1.4008e-01,\n",
      "          -4.5325e-01, -8.1718e-02,  2.4102e-01, -2.5854e-01,  3.7204e-02,\n",
      "           3.9667e-01, -5.1366e-02,  1.6949e-01,  2.4756e-01, -3.2918e-01,\n",
      "          -1.1899e-01, -2.6279e-01, -8.9338e-02, -1.7729e-01,  8.9606e-02,\n",
      "           2.7265e-01,  1.1919e-01,  4.1138e-01, -7.5046e-02, -1.6690e-01,\n",
      "          -1.2615e-01,  1.4873e-01,  7.9596e-02, -1.1735e-01, -8.6077e-03,\n",
      "           4.4017e-01]],\n",
      "\n",
      "        [[-2.2695e-01,  5.9847e-01,  4.6157e-01, -9.2765e-03, -4.1254e-01,\n",
      "           6.0146e-01,  4.5330e-01, -7.3782e-01, -8.7741e-02,  4.7939e-01,\n",
      "          -3.5257e-01, -4.3295e-01, -3.4646e-02,  6.0596e-02, -1.4648e-01,\n",
      "          -2.9064e-01,  5.2916e-01,  2.5413e-01,  3.2484e-01, -1.4649e-01,\n",
      "           5.2622e-01, -1.9882e-01,  3.8730e-01,  1.3898e-01, -3.3124e-01,\n",
      "          -3.3956e-01,  6.5737e-01, -1.9615e-01, -4.8602e-01, -1.3315e-01,\n",
      "           2.0596e-01,  4.2003e-01,  1.5026e-01,  8.2536e-01,  4.6583e-01,\n",
      "          -2.1601e-01, -3.2772e-01, -2.6796e-01, -4.8956e-01, -4.3314e-01,\n",
      "          -3.2501e-01, -3.8601e-01, -1.3953e-01, -2.5617e-01, -1.5381e-01,\n",
      "           4.8154e-01,  3.8229e-01, -3.8233e-01,  1.5527e-01,  3.8608e-02,\n",
      "          -1.7689e-02, -1.1394e-02,  7.0753e-01,  8.4274e-02, -1.4614e-01,\n",
      "          -2.9823e-01,  4.0103e-01, -1.4210e-01, -2.6070e-01, -4.4242e-02,\n",
      "          -1.2654e-01,  4.0627e-01,  6.7332e-02,  4.1162e-01,  3.2786e-01,\n",
      "           7.9775e-02,  3.5397e-01,  1.0885e-01,  3.1856e-01,  1.7606e-01,\n",
      "           6.9486e-01,  2.6135e-01, -1.9520e-02,  2.3589e-01,  3.6486e-01,\n",
      "           3.8748e-01,  1.9322e-01,  3.0249e-01, -5.3227e-01,  3.0666e-01,\n",
      "          -2.2932e-01,  1.4652e-01, -2.5371e-01,  1.2621e-02,  7.1160e-01,\n",
      "          -7.6727e-01,  1.2540e-01,  2.3297e-01, -2.7908e-01,  3.7645e-01,\n",
      "           5.7427e-02,  1.8691e-01, -2.5234e-01, -4.9806e-01,  3.4101e-01,\n",
      "           3.3047e-01, -4.5971e-02,  7.9108e-02,  2.2785e-02, -7.6981e-01,\n",
      "           4.3328e-01, -5.3604e-02, -1.0099e-01,  7.4302e-01,  6.6245e-01,\n",
      "           1.6842e-02,  1.1730e-01, -4.4944e-01, -4.0616e-01, -3.8556e-01,\n",
      "           8.8930e-02, -1.0778e-01, -6.2520e-02,  1.3421e-01,  2.7672e-01,\n",
      "          -2.7383e-01,  3.0830e-01, -6.8846e-02,  3.5503e-01, -2.8487e-01,\n",
      "          -1.4299e-02, -6.6570e-01, -7.2768e-02,  5.4033e-02, -3.3705e-02,\n",
      "          -1.0052e+00,  4.2941e-01, -4.3954e-02, -3.6921e-01, -1.6193e-01,\n",
      "          -2.0812e-01,  6.2445e-01,  7.0669e-01,  1.9209e-01,  4.2268e-01,\n",
      "          -3.6501e-01, -2.9455e-01, -7.0977e-01,  9.0473e-01,  4.6708e-01,\n",
      "          -9.0375e-02,  1.0022e-01, -6.0321e-02,  2.2924e-01,  4.2484e-01,\n",
      "           7.4876e-02,  3.6649e-01, -3.9693e-01, -8.2600e-01,  4.0910e-02,\n",
      "          -1.2635e-01,  3.4936e-01, -8.4678e-02,  3.1934e-01,  6.6502e-01,\n",
      "           9.9202e-02, -2.1856e-01,  1.8967e-02,  1.0273e-01, -5.1738e-01,\n",
      "           3.8608e-01, -4.6017e-01,  4.7464e-01, -2.0158e-01,  3.1331e-01,\n",
      "          -3.8921e-01, -4.0468e-01,  8.5386e-02, -9.5290e-02,  6.2118e-01,\n",
      "           3.9515e-02,  2.8465e-01,  1.3993e-01, -1.4232e-01, -4.6383e-01,\n",
      "           2.3922e-01, -1.4472e-01, -2.4633e-01,  1.4825e-01,  1.7585e-01,\n",
      "          -4.2734e-01, -2.9023e-01,  1.9567e-01, -4.2453e-02,  3.4833e-01,\n",
      "          -3.0918e-02, -1.5669e-01, -2.5934e-01, -8.9688e-01, -1.6693e-01,\n",
      "          -4.6459e-01, -3.8207e-01,  8.1080e-02,  4.5575e-02, -2.3030e-01,\n",
      "          -2.0123e-01, -9.7226e-03, -2.7144e-01,  4.0856e-02,  1.4392e-01,\n",
      "          -1.8729e-01, -6.3969e-01, -2.5761e-01,  4.1503e-01,  1.1145e-01,\n",
      "           5.3042e-01,  3.3707e-01, -3.2346e-02,  3.1495e-01, -2.1307e-01,\n",
      "           4.7722e-01,  7.1225e-04,  2.2755e-01,  7.4070e-01, -2.3218e-01,\n",
      "          -1.9179e-01, -1.4892e-01,  5.3332e-01,  2.2815e-01, -1.8960e-01,\n",
      "          -6.3403e-01, -1.9157e-02, -1.6041e-01, -1.6196e-01,  6.1037e-01,\n",
      "          -2.6308e-01, -6.5570e-01,  9.6173e-02, -1.3365e-01, -2.4178e-01,\n",
      "          -3.0515e-01, -1.5491e-01, -3.9151e-02,  1.3255e-01, -9.0628e-02,\n",
      "           5.8831e-01,  9.8446e-02,  2.6101e-01,  6.1369e-01, -7.2502e-01,\n",
      "          -6.4708e-01, -6.6815e-01, -5.0164e-01, -6.0093e-02,  3.2836e-01,\n",
      "           2.0213e-01,  1.0067e-01,  5.2749e-01,  1.7974e-01, -2.2358e-01,\n",
      "          -4.7211e-01, -8.4501e-02,  2.9615e-03,  6.0532e-01,  2.2081e-01,\n",
      "           4.3533e-01]]], device='cuda:0')\n",
      "embeddeded_captions_plus_features size torch.Size([10, 12, 256])\n",
      "embeddeded_captions_plus_features tensor([[[-4.0973e-01,  3.1127e-01,  3.7831e-01,  ...,  2.8068e-01,\n",
      "          -2.4296e-01,  5.8995e-01],\n",
      "         [-1.1482e-01,  8.2333e-01, -3.1716e-01,  ...,  1.1209e-01,\n",
      "          -1.2277e+00, -1.7862e+00],\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         ...,\n",
      "         [-4.2025e-01,  1.5465e+00, -7.1158e-01,  ...,  8.3160e-02,\n",
      "           2.2956e+00, -1.7981e-01],\n",
      "         [-3.1903e-01, -8.8822e-01,  1.1850e+00,  ...,  9.9924e-01,\n",
      "          -2.4681e+00, -4.7401e-01],\n",
      "         [ 7.3205e-01,  2.5770e-01,  2.0781e+00,  ...,  2.9537e-01,\n",
      "           8.9930e-01,  5.3815e-01]],\n",
      "\n",
      "        [[ 1.0774e-01,  6.0399e-01,  1.2885e-01,  ...,  1.1518e-01,\n",
      "          -3.4511e-01, -6.5454e-02],\n",
      "         [-1.1482e-01,  8.2333e-01, -3.1716e-01,  ...,  1.1209e-01,\n",
      "          -1.2277e+00, -1.7862e+00],\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         ...,\n",
      "         [ 2.7244e+00,  9.8465e-01,  7.6766e-01,  ...,  6.7067e-01,\n",
      "          -2.0194e-01,  5.7890e-01],\n",
      "         [-1.4458e+00,  5.8691e-01, -4.5609e-01,  ...,  8.0287e-01,\n",
      "          -9.0601e-01, -6.8945e-01],\n",
      "         [ 7.3205e-01,  2.5770e-01,  2.0781e+00,  ...,  2.9537e-01,\n",
      "           8.9930e-01,  5.3815e-01]],\n",
      "\n",
      "        [[ 2.7830e-01,  5.9770e-01,  4.7459e-01,  ...,  2.1810e-01,\n",
      "           3.2453e-01, -5.0564e-02],\n",
      "         [-1.1482e-01,  8.2333e-01, -3.1716e-01,  ...,  1.1209e-01,\n",
      "          -1.2277e+00, -1.7862e+00],\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         ...,\n",
      "         [ 2.8731e-01, -1.1558e-01,  1.5513e-02,  ..., -1.0197e+00,\n",
      "          -7.9557e-01, -9.1092e-02],\n",
      "         [-9.7444e-01, -3.5782e-01,  1.2849e+00,  ...,  6.7038e-01,\n",
      "          -2.2083e-01, -1.2066e+00],\n",
      "         [ 7.3205e-01,  2.5770e-01,  2.0781e+00,  ...,  2.9537e-01,\n",
      "           8.9930e-01,  5.3815e-01]],\n",
      "\n",
      "        ...,\n",
      "\n",
      "        [[ 1.4888e-01,  1.5345e-01,  4.6901e-01,  ...,  1.3811e-01,\n",
      "          -1.3484e-01,  2.7338e-01],\n",
      "         [-1.1482e-01,  8.2333e-01, -3.1716e-01,  ...,  1.1209e-01,\n",
      "          -1.2277e+00, -1.7862e+00],\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         ...,\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         [-2.8189e-01, -6.6288e-01, -1.2132e+00,  ...,  3.3652e-01,\n",
      "           6.4154e-01,  1.6252e+00],\n",
      "         [ 7.3205e-01,  2.5770e-01,  2.0781e+00,  ...,  2.9537e-01,\n",
      "           8.9930e-01,  5.3815e-01]],\n",
      "\n",
      "        [[ 2.0018e-01, -8.5007e-02,  4.5852e-01,  ..., -1.1735e-01,\n",
      "          -8.6077e-03,  4.4017e-01],\n",
      "         [-1.1482e-01,  8.2333e-01, -3.1716e-01,  ...,  1.1209e-01,\n",
      "          -1.2277e+00, -1.7862e+00],\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         ...,\n",
      "         [-1.6021e-01, -5.6203e-01,  7.2017e-01,  ..., -1.5052e+00,\n",
      "           3.2105e-01, -1.4497e-01],\n",
      "         [-1.8472e+00, -1.3512e+00, -1.4133e+00,  ..., -5.0516e-01,\n",
      "          -1.1378e+00, -4.8026e-01],\n",
      "         [-1.4507e+00,  4.8039e-01, -2.9335e-02,  ...,  3.5409e-02,\n",
      "           6.1306e-01,  1.0780e+00]],\n",
      "\n",
      "        [[-2.2695e-01,  5.9847e-01,  4.6157e-01,  ...,  6.0532e-01,\n",
      "           2.2081e-01,  4.3533e-01],\n",
      "         [-1.1482e-01,  8.2333e-01, -3.1716e-01,  ...,  1.1209e-01,\n",
      "          -1.2277e+00, -1.7862e+00],\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         ...,\n",
      "         [ 4.2432e-01, -5.2784e-01, -1.1705e-02,  ...,  6.2196e-01,\n",
      "           1.1713e+00, -4.0621e-01],\n",
      "         [-2.7104e-02,  1.0107e+00, -1.8487e-01,  ...,  1.7162e-01,\n",
      "           2.2215e-01,  2.4007e-01],\n",
      "         [ 7.3205e-01,  2.5770e-01,  2.0781e+00,  ...,  2.9537e-01,\n",
      "           8.9930e-01,  5.3815e-01]]], device='cuda:0')\n",
      "embeddeded_captions_lstm size torch.Size([10, 12, 512])\n",
      "embeddeded_captions_dropout size torch.Size([10, 12, 512])\n",
      "embeddeded_captions_dropout_linear size torch.Size([10, 12, 8855])\n",
      "type(outputs): <class 'torch.Tensor'>\n",
      "outputs.shape: torch.Size([10, 12, 8855])\n"
     ]
    }
   ],
   "source": [
    "#vr print all sizes of all different layers\n",
    "\n",
    "# Specify the number of features in the hidden state of the RNN decoder.\n",
    "hidden_size = 512\n",
    "\n",
    "#-#-#-# Do NOT modify the code below this line. #-#-#-#\n",
    "\n",
    "# Store the size of the vocabulary.\n",
    "vocab_size = len(data_loader.dataset.vocab)\n",
    "\n",
    "# Initialize the decoder.\n",
    "decoder = DecoderRNN(embed_size, hidden_size, vocab_size)\n",
    "\n",
    "# Move the decoder to GPU if CUDA is available.\n",
    "decoder.to(device)\n",
    "    \n",
    "# Move last batch of captions (from Step 1) to GPU if CUDA is available \n",
    "captions = captions.to(device)\n",
    "\n",
    "# Pass the encoder output and captions through the decoder.\n",
    "outputs = decoder(features, captions)\n",
    "\n",
    "print('type(outputs):', type(outputs))\n",
    "print('outputs.shape:', outputs.shape)\n",
    "\n",
    "# Check that your decoder satisfies some requirements of the project! :D\n",
    "assert type(outputs)==torch.Tensor, \"Decoder output needs to be a PyTorch Tensor.\"\n",
    "assert (outputs.shape[0]==batch_size) & (outputs.shape[1]==captions.shape[1]) & (outputs.shape[2]==vocab_size), \"The shape of the decoder output is incorrect.\""
   ]
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}