how to get size of rdd in memery

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

how to get size of rdd in memery

qingyang li
dear community, can anyone tell me : how to get size of rdd in memery ?
thanks.
Reply | Threaded
Open this post in threaded view
|

Re: how to get size of rdd in memery

Mayur Rustagi
http://<Master URL>:4040/storage/

Mayur Rustagi
Ph: +1 (760) 203 3257


On Fri, Mar 7, 2014 at 12:09 AM, qingyang li <[hidden email]> wrote:
dear community, can anyone tell me : how to get size of rdd in memery ?
thanks.

Reply | Threaded
Open this post in threaded view
|

Re: how to get size of rdd in memery

qingyang li
in that page, it is empty , it does not show anything.
Here is the picture.

<img src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAABTsAAADeCAIAAAB9mUOXAAAgAElEQVR4nO3dfXMc1YHv8XkJ+w5230FulaqoEi6vS/xhyHXFKW9FFyI2gG94WEMFA1ZqWDDmxvem1oAtuTAYJxCvsCwcygjjZSnrIVDxYrBhLdmy8ZOQpZEHJZKsrLIWtmY0kvv+0T2nT58+p3tmNA9nrO+n/IenH04/nW71b87pnsTSnWIxNbD0Twn33+L01aWlpaX/+z/EkIh/i3t/XONVt96lS5eGh4dHRkZGR0fHxsbGx8evXbt27dq1dP1zN2R8fHxsbGx0dHRkZGR4ePjSpUu13uUAAAAAsJRYvGMMdHsh/Nm/8YZc+lQT0V/4u8XtP/Dj+vYf5G7M1HS964Cc2FOplJvY0+n0d/XPDe3j4+OpVEpO7LXe5QAAAACweCck9tyNmdyJ34kcvrhzjRi19K8Pexl+749zfbsWUwO5qZGlZ//Gz/apgRqueb24fPny8PDw1atXRQO7HNcn6lM4tI+NjV29enV4ePjy5cu13uUAAAAAUM+JPTc1kuvbJTeYe//e3+xPc2Nm8dKngY9yA7s0ChEuX7787bffahN7rXP3smgT+7fffktiBwAAAGCD+kvsuRsz+qAums0Huo0z71wjpsyd+F0V17q+mRJ7rRN3GZDYAQAAAFgrkasvcp92Jajvfzh3+oOIWRf3P+y3rv/+6aqt8h1gBSb2Wu9yAAAAAMjVW2I/+lLgNe8v/N3i75/OXfxD/IwnfufPtf/hyq/oHYXEDgAAAADVV9+J3XvZ+4nfLfz39ej5Fvf+2O8PX0jCh4TEDgAAAADVl1goycVvvvn61MmvT538r5mZ0kooTfav0+Ze8Q8tjP6ncc4L/X7I37mmiqt8J1iBib3WuxwAAAAAFopO7L/dt3fD+nV339Ug/rXvfLWquX3y28X9D4VD++I//+3l3//Le53vmuaTXzu3cKG/eitc/0jsAAAAAFB9RST2/5qZeajlATmri39PPfFY5VZRb/Lb3NGXRHv74u+f/u3uHXff1fDbfXsjZrGkmT3d25b0tfWm5XGDg2njjLVSQmIf6Him2fdMx4A87tixAeOMVVamxB48pL6Dg8Xu63Rvm1IlbFONKlq+/VnKwm08BwEAQIUMHtTel7uDl3nvUWwhEdOXtj5l2QpBukMLFGkaLq1DRW/ixP3zcm6kxR1gee7GBw+GN1oMK3IRRST2X27ZrI3roqW98KLKJfvX6YXenZc+2ie+SpDb2MfHx//toyMLn7+T/eu0O0RunK9VM3u6ty2Z7Drn5J3r8utwurct2db3XU3WK0qxiX2g45nm5t2nxDae2t3c3LzjmBj3bNdQ1SJ5jDIl9u/62pPt/ZOO6vZisfs6t3Tbub2UK3a2aqlSFS3f/iyWrecgAACoBDmuB0P7ykrsgwfjJ1L3VX4G0/DA2Ook9hqWoCprYs8W5g/9/SKc33fPmrbXXml77RV5yNenThZYVNn95q03xZqI1fjL9esPtTzQ9tor7i+3L27/Qe7QL7L/8bb8yrparGy6ty3ZdW4pJwbkls51JZNtPelsNpvua0+296VrsV6RikzsAweea3791PysGDA7f+r15uZnOwYmJiaGDrU2tx6yPrEXuYdsPXJlV6UNrd3+XDFHEgAAZLODnclk/kY8m+5pkz65ozoHy1B+4YWUZaHFFuhtd9xSpaICc5iG+5/LvE36LfAOW81KUA12hjdaDCtycYUmdrmB/Q/9/e5AN8Y/9cRjf7l+XTvXX65fLzbJf33qpKk0k6eeeEysWyqVyubjurtu2ofevWb2/zxc1ILKId3XnmzvDRyf3JLj3F5ckKp08LIRHJjN5k+MZDLZ1jPY06Y9K+QaEiynhPOlyMQ+dKi1eUtXoOP77Lzj5Oampb7y+Y7y0iCvFd4dtqPDG7Hj2EREJ/tjO8SwYx3PBIsIlVujxO6ek4PKJUs9U9M9bclk56AYnO5pS3b2eDO5B0131dMXrhne1pM2XDZ11UZbbLiKVkrU/kz3tEnLH+z0Pxjqf8R+S2cDHwfDG2iaN3holn2KAQCAWvBuqnU3NiKISjfe4ZvxwHAv/3d2tuWHy4HZm6dzMBsM0rr/++WL2wole4ubD2Up8ihRUH6UZrV1eUO7dYGSpGhuGi6+AGmL/D5Am3fcG7Oe0I6PHp5WbvAM3xeEl5gO3zBHFmK6/Q7Vn2ondjkVv9f5rhgu0rvs61Mnf7ll8333rBGzbFi/7uiRD02Fp1Kp7dtekqe/7541v3nrTW10P3rkw6eeeMz998stm7PZrPx0vTuN+H7hvnvWLHy01ZjYP9pa4OaXz8LiUJdSx8SY25P9bl/g24sL7iEVvecn+9uTyYPiTM53GB46mEwmk11nslmvPuVnmOxvl07DNr9/8WR/e/GJosjEPj335eu659cnJqbncunu1ubW7rSTm5sOdp9Pd2/Jh+uhQ63Nzc27vnQcx3HmZyeO7ZA62ae7W5ubXz2Wj+tbutOO4zjOl7uam5ub2z8VcT0/Q7p7S2g9qpzY+9qTyWRb358DR2Bhor892Sa+vEn3tiXb+/+UEyW5cx0cchzHcZZygeMrHUV94drhusmM1UZXrFpFKydqfy4s3j7X5Z0N7klye3HBuCGB4ee6/D8owSW4H79TNjByn4tDU45TDAAA1IQcToN/vgOxNSLkSrMqs4i07wdbXfzVpHpz4aFWHHUy8yj9aofyq2nrdNk/lNiVBve2nnR0M38g1nrNV/6qSlsU2DjtcCWxS2MDS4lYotxeEy4ktBqB5p3w5tW6jf3uuxounD+vnewv169HPO7+UMsD4RAu92lX/m1Yv05ekGg5l994l81m5emz2ez2bS+JIW2vvZL983Du0C8W//lvw4k9+x9vF7qfyii35Cco+fzKBlNE+rs/OY7oPb8w0e+1zQ8eTCa7hry8lPtTf7uX2AcPJqXu9u4XAwcH3TK7zop4tbB4Wyq2QEW/eW52Ph+tQ+3ccq/4Y682+93n3Zy/81g+sb/+eb5b/cDFEccRneynrxz2mvCP7Wxufv3LuWl3kSPdrV5iDxTrlfuqoZ29jIk9LJ8Z+9qlYyYOZSCyu4F9YiEbTOxdZ/OHKnB8/cNrKlw3XDdZVLUxFVulXvHG/enVe/erzfzKGzfE+ybEnW9JVH5tYlc2MHqfi0NTjlMMAADUiJJQlQZzpeurPpgpbdOhtni3E2Uh3+grJRia5YPd9/MboBkVKMC42hG94v3JlInE2piGq2Votz2dDtxUBoK3NEdBww3/KWKJocSuhO5A3tatRmjXlS2xZwpz9MiHclS+754135w7p0wzMz1tepm8+Pfk44/Ks/zqpa3R029Yv25meto08a9e2jozPS0XLj9d/6uXtgbWb+SrhY+2uo+1L/1TInfoFwVueyVkF28HXj3X1nMtk8l4acGdIpvNZDID8hdt7X3pzLXe9mR733einIn+9mTXmUzmWq8m4rT3XstkRaN+Mtk5UNralvbrbtNzOfHquddFg7uc2D9tb259/6KY4eL7XhQfOtQqj5ienp6Q+r83Nzc3tx4amhjo2hKY6srh1ub2TycmBrq2NIcovfRjE3uReyitfVPa7cWsGOkfM3GUsxP97d6Rv9bTlmzvn8hKY5W5znTJnzLf9bUn23uvmQvXDg9NZqw20cWmi9w9RYvcn5lMJrv45/72pJunM5lMRP0fPJhMdp3N6pfgb4h2Awvc5+U4xQAAQC1dk2O7++fcvQsXf9qVj5ngbbp7QzfQ6f9fnsbrGC6PMFCXIpUojdJPFTfKuNrexgfvYkKTBUvyP5mGG7fJsNHysq71tIV2Y+dAAcPFf/JjSlmiXIi8tPBSlOGhZahrIIbpZzEqNLFnMhkljYdD+5OPP6rE6aNHPuw60KEMP3rkQ3d6pXX9l1s2dx3oOHrkQyWZ/+atNzOZjJzM3XD+5OOPHj3y4Vcnv5RXyRjX7ZVbmswHt0CKcKtSPrZM9ruj1MSU7nMTuzbiuAkntyR9NVBSqlj277HPzqe7W5ufOzAQTuzSS+jEKPXtdG5Yz/d/T3e7Y9Wphg65iX3okNvvPiDnNcVXMrGbgqwpHLpRr63nmhTYjdn4TFfouOsmix0e/GisNgUWWynxi8m/d3RAmkG3IWe6ksmuM7FLMCf2+H1ejlMMAADU3rUeKVmbE3sg3odDfjix+w9zx90hVDKxG1c7mNhNkwVKlmYxDTduU3h7Q1G5gom9gCWWJ7Ff62lT18CfsHKJfWZ6Wo7EbkIeGxtzx8qN8A+1PCCGu+QQ/sstmzOZzNjYmFzOVye/lKeXS7vvnjWZTEZO5iLzZzKZ/r6+cMu8vXFde3i0SWDgoPc4rds8OHjQbWPPnu1KJg8OinkHD7qBJHu2K+6bOzdWnOvyY06hikvsAx3PhB8c16bxT9ub3Rjv6tvV3Lz7j9OhxH5sp//kuzdZ66Ghiek/7m5u3tU3Ic/e/umEO1wqNlJNE3smkzvblWzrGehpS3YNyQ3y2sQuH1/RdLy8xG6sNpYn9gH3JQ/nuvIXY+OGiIbx6CWYEnsh+9xX+ikGAABqQI3Y8mdjYr/mPcV8LZNRIqopsYfmilkhMZn3UU3MgW8WRMSOGWVe7cCmGicr9v+afaDbXHVviUgszSHCb9TwYJY2ReKoJeoSuzy1qYXcsCxlUXIBFUzsmUzmm3PnlND+UMsD7ijRAn/fPWtEP3bZhvXrREf3TDDDK3HdJbfMj42NdR3oEB/ltn3tY/D9fX1FbVf1eB1o1a9rvLwmx3E5LXi1v70v7WY85TTuOpPJZNxH2kXBooYp3zApveoLU1xi9148J4f2gY5n8o+cyznbffb81fwPtT+bf3hdSexysPfeAd96aGhiYvZz8Ztx+Xb49k9FsWL5x3aEX4FnS2J3D2cymew6m1PGKnO5x1f+/tKdZXmJ3VhtTNOr3xhVSHRid/P6Ui7j/jRi50DGvCHZCXW/aSK+e4KFNrDAfV6OUwwAANRCoHu0x7s/iEnsunmiErv564Dw/2PXJ7gKgQZ83drFrLa0VLchKXYyv9So4Zp9oNn9St7xE3tgizS9AZThSvCWw730f9MS5fu52EIKS+zuhge/XwgvoiCJ+SKFQ/tHH3aPjo6Kj7te3aGdUY7o8/PzIsA/+fij2un37X1DTH/qyy/kj6Zilaffi9206lhYCr52Lpls6590lhbckV5+6zw9v7Akutgmk239k+7rsd0CxJi2vv6uZLJrcH5+fj6buy0X3N4/eTuXDU7uFXU7ly1unYvtFT87H3ztXHPzc4fT+XfHzX7+ungX3fRcLt0tnjrffcqbRkns7s+5+yWdet3L/LPzzqnd3vBn3+9+Pf+ueO+V9OIZ9u60qVO8MbEXeVTTuseok8lk27Fxd2R7b1qe1v/oHvKuswvqWGUu5fh2nfPqjKnwyIVKHw3Vxji9VEUrKGp/nu5MJtv7/+SdMW6oPm3cENN+m19YkgYfHDrXpdnAwvZ5OU4xAABQI+PHAun32Lg3/HRn4I4n8PF0pz+5O3/naTHYL0ItxP8kD9f9XyzAsALSKnSeVkf5W5QvKHq1pRHSymkmUyf0mYZrVlw3Mr+0053uhOPH2pJtx451qmVGDx+X/qMcWWnp+iWK4Z2n4wsJTBD6KAtUrsJm0Sk6sc/Pz5/68gs5Hrc+97Q85NSXX2jnan3uaRGn5+fnxfT79r6hnV6J6GL2++5ZI08mN8WLadz/l7Bp1ZHN3Q48bSvd3S+4D8QuLfj/9yZZWHLyWcMfczvnPmqrKVgqVSoouLRClfAcu/TaOfUx8tl5x3HEy9+lCf3Xwc/lgg+ee7N4Jc3O+9OKMbm5P8rvsZOXb4zr5UvsyiEN7u1s7ra825WPC0uOf2SlscpkylLEDKbCoxca+KirNubp5SpaMVH7c2FJrsXZ3G2xMob6r91v6uCFJf0GFrDP58twigEAAJTIi4WVbU6pKlOgLTLo3jFKSezzwTj95OOPKu3h2llEy7ybpYtN7CKZK23yoq3+7rsalCftP/qwu7Sts9rpzqTyrU/XmUoHhGW/ea4yAt3dBzqe9Z6CL0qZEjsAAABQFcFuAcbG7fpFYg+KT+wz09O/emmr+3S6GCg3qrc+97ScrrW94uUJ3CAtB37tckV394daHpgPBX5BKUd+Ed1996wZHR0tZm/Ug0BnXrmXbwVZmtjdN9A3hzrVF4PEDgAAgDoj9e1WOlzfCUjsQYlbkfbtfePepr8XL2B3B16fmpL7oh/p/kD5/bYj3R8ohchPmLsD5bbxfXvfkKc/0v3Bvr1vyI3qt27d0k589epVObG7A+W+8T/76f3RG1iPMnKP4cVsFZZoaWJX+t4XH9cnzIm9CnsVAAAAAKLFJHYliv/sp/fvenWHHLY3rF+nBHi5q7wy8d13NZz84oRb8sF3/1V5V9y+vW/s2/vGz356vxvLxYy7Xt1x8osT2q8D5OEiyV+fmhLfMoS/DkAJrE3sy0diBwAAAGCtmMTe19urRHHln5vAo6cxtb274dxUrBy55Y8i898Kxn45mSurLc+CEpDYAQAAAKD6Ejfj/J+tL2pD9b1Nf3+k+4ObN29OT07KA7UTb1i/7uQXJ5SSpycnTaH9SPcHct5+68094uPIyIgoQR6ulC/3jd+wft305GTslsJkBSb2Wu9yAAAAALgZn9hv3rz51pt7lJ7wu17dIZKz3ADe29Pz1pt75By+6bGfu8He5Ej3B5se+7k8fWfH/nNnz2567Ofuv3Nnz7rTuP+UFZMnk0eNjIy0Pve0GBu9DohGYgcAAACA6isosQvhdvKbN2/29vSIvE1T9h2JxA4AAAAA1VdcYteSu6YvvzRYiMQOAAAAANWX+H7Zdr7yL+JN8ssvDRZagYm91rscAAAAAL4vQ2IXT6Fveuznyy8NFiKxAwAAAED1lSGx445HYgcAAACA6iOxI54psdd7aHc3gcQOAAAAwE6JOSDO5cuXh4eHtYm9fkO7WH8lsQ8PD1++fLnWuxwAAAAA5kjsiHfp0qXh4eGRkZHR0dFUKhUO7fVLxPVUKjU6OjoyMjI8PHzp0qVa73IAAAAAILGjAHJiF83sbmivd+6GuA3sJHYAAAAAViGxI96lS5euXLkiHmV3m9lFbq9r7oakUinxEPuVK1dI7AAAAABskLgBxLl48aL7KPvIyIgb2uXcXtfcrO7GdbeB/fLlyxcvXqz1LgcAAACAGyR2xLtw4YLbzC5C++joqNtDvt65GyLiutvAfuHChVrvcgAAAAC4kfgGAAAAAADYJ/HfAAAAAADAGn4be60fpAcAAAAAAAHff//9999/n7gJAAAAAABscuvWrVu3biXmAQAAAACAfRIZAAAAAABgh6wksQAAAAAAAOyTyAEAAAAAAMssLi4mFgEAAAAAgH0SSwAAAAAAwD6J2wAAAAAAwD4kdgAAAAAAbJRwAAAAAACAfUjsAAAAAADYiMQOAAAAAICNSOwAAAAAANiIxA4AAAAAgI1I7AAAAAAA2IjEDgAAAACAjUjsAAAAAADYiMQOAAAAAICNSOwAAAAAANiIxA4AAAAAgI1I7AAAAAAA2IjEDgAAAACAjUjsAAAAAADYiMQOAAAAAICNSOwAAAAAANiIxA4AAAAAgI1I7AAAAAAA2IjEDgAAAACAjUjsAAAAAADYiMQOAAAAAICNSOwAAAAAANiIxA4AAAAAgI3kxD53/uM9L2zcsHZ1Y4NrVdMPWza9duDzkTn9zHPnD7+45bdDVVlRAAAAAABWlHxinzi+88FVDSZNj+4fyMizZWbOHH7xH1Y1NDT8ZA+JHQAAAACAsnMT+5X9jzQa47oX2p//ZMaf7WhrfjiJHQAAAACACkg4juN8tXOdl78b125+5/MrM257+tzk1wc2r23UZXMSOwAAAAAAFZVwHGds/yP5/P2Lw8oj65njv743P7L1qOM4ztCen+ja4N2RnrnzH+/Z0pJ/IH5V04aNL7z9WSoTLNovqPXoxPGd/7tpVUNDQ+PqH23c1e+25mdSn729peWHTfne+o2r127YuP3w+fBT9e6U7vJWNbVsefuzVCZQfmDqufOHt2/c4BW7qmnDxu0HTqorBwAAAABAbSUcx5l5b5Pf+f2pA2dmItNrXGI3PhHfuHbzexczuoJ+cv/9Uqf8dTu/chwnM7DnfkNP/abWoxPSCmUG9oYX2PTU+726xJ4Z2P9ok6bMVQ/uPC4XCgAAAABAbSUcx3GuvP2Pwfj6PzduPyA6xyuiE/vQXlPODoVtbUGNq59494ojddRvfOQ35+ccx5kbOdwqorbUFT/T/7IugTc0NDY1rVET+8wnz+snbmhoaGjc9B6ZHQAAAABgC/fNc4bY6yZ33W+7GZ5jn3n/KZHXmx7d0zcy5ziZmSt9O/wY3/Ryv/dFQCCxN7UelpfT/7KXtt0Gd9fA7g35yUUGH3v3UWmJb38xk3GcuZG+PYGG9PzU/vP60rT/9vL6fAnywgAAAAAAqCnxe+wTvdv/wfDzbo2r/9eLytPj+sQuPRC/bscJuYV+ontzvsG78an33cfU5cS+6b0ZJ5Y0Q36pUof+NVt7pSVmereuEaV7if3Ejnu10/pB/t4dJwrecwAAAAAAVFJC/uC+MK5J/xT6+pd7/U7j2sSe6d6cH7ph94CyID8uNz7/ieM42gCuk5kZP//5v7/z2iZ5xfIzhEsVPnleNL67iV1K98oXBKJFv+H+vRcK3nUAAAAAAFRQQjdwbvLr/s49L2z80erAM+l+h3Z9YpciuPJ2du3IyMmjvz4QS434lblQ8YYH8APC3zQAAAAAAFAT2sTuy8ycOfCUeCTcb8eudGKfOPq8/0Pwjat/tPGFPR983rcr1Chf7sSu/e4AAAAAAIDqS8idxfWd06UJRKfx4nvF+z3P17zc7zhOZGL3nyxvvH/3V/kn6DUzFNMrXnrKfnM3P78OAAAAALBbIhCElV86dxzHcTLHf31vKOn6iV3O5lJJxb15Tkns0hg5W2tmML55Tlpg7JvnAAAAAACwT8JxnCv7H/F7oK9/3v8l9rnJrz/+fw/6T5L/49tXvNn88NvwaEcq48xNTs4pJRXz627mxC69I07+1XgxOPh7cuLX3XYEfhVe++tu7to5cyN9Ox5s+tHGZ197p//rSc0P2QEAAAAAUAsJx3GczMCeQMLVk14851zYe78y1u0wH1dS0/OfiAQe0Sve70Lf0NTancoEfza9Qe6Lb/gp+QBR/MR7m6LWrvGR/VccAAAAAABskH/z3MTxnQ8afo69oaGhoXHt890puSN56DVuone8sSS1jOg3z7VqcviqVfmCG1uPipIyA3tDC2xc+/yeX+uKnzi+w/CVQvDn6wAAAAAAqC35XfFz5z/e88LGDT/0f1FtVdMPN2x8Yc/HZ2ZCj31nUp/tedL7+bfG1Wtbtrw/FCrJK2hV04aN2w+cTCllRP+6Wyb12Z4nvRIaV69t2bLn4/Nz/mPr4mn4/MRv538JblVTy4uHz89JxedfdScmPnlgu1i5hsbVa7WrBwAAAABALcX8ulsd83vW61+BDwAAAACAzeo9sQ/tfXhty6bX3vn3z8/7r40Lvuwu9LtvAAAAAADYr94Tu/yueD35hXkAAAAAANSLek/sppfU5dvX7995Yia+DAAAAAAAbFP/id3RvTKP18kBAAAAAOrcHZHYAQAAAAC445DYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABslHMfJ5XJTU1OpVOoqAAAAAACogPHx8ampqVwuV0Rid+P67OzswsJCxb4XgF2uXr1a61UAqIdAPE4TrBzUdtQj6i2KlcvlZmdnU6lU4aE9cePGjenp6YquFmzDxQU2oB4CsThNsHJQ21GPqLcozezs7NTUVIETJyYnJ2/dulXRFYJtuLjABtRDIBanCVYOajvqEfUWpcnlcuPj4wVOnEilUouLixVdIdiGiwtsQD0EYnGaYOWgtqMeUW9RssIrT4J6tgJx0GED6iEQi9MEKwe1HfWIeouSkdgRhYMOG1APgVicJlg5qO2oR9RblIzEjigcdNiAegjE4jTBykFtRz2i3qJkJHZE4aDDBtRDIBanCVYOajvqEfUWJSOxIwoHHTagHgKxOE2wclDbUY+otyjZMhP78W0NYduOm8eKcXFjNUuRxo51tJgnR/mY64d0+Fo6xoIj7DowbmUJrmRluPvErq2/MxRUD5d1kMtySTm+Tb8ShV/r4heQn1GtbBGjsELoThO3Ypen+mlVuOLVxQmOGijy5qRclbOEcvxzUK47+qG409Wo3i5fIYEuej3t2ZZ6VYnELmqbfmy+KkaP1S3FH0dirxJD/QgdO5uzAom9/unrYfQXhsWpdmIvoUZGVC9qHpxaJPbKVry6OcFRA8XenNSOdwvS0hK+iS3tTwHqWP3UW0XhkS26BOs2rI6UJbHLB0AeEhobaCyPHhteilw5gn99td/Ce8V35C+L245L10h5GfIdDVVJoa8fgQwsjmPw1jC/K+Wh0rntFbFtW4s/xtiaIh839Z4p/vBFJnbt7OGaqAwxLJTrUaVERBFxYPMHRfuVoL5tQzpY+UuKPzJwHM3VTJ4hMrFLw91V032xqWyNOEGCth2PPO/Uehh5DnprrW5ZoFSqdH0wnybaI1jaRViUVpmKp65eXZzgqIFibk6C/w9Fj1Adi7jqyWUWVZPdEy1wl+Gde7H3MyXdzZpvt4LzUamrq0b1Vp2s+AtyMYFOf/8QPne4tyhOdRO7pvaZxmqWsm1b6ELpjw3VYkPzv1KHwlNx5ZJFXVzMdzbKMdbt+ODELR1jxquRMmWL/BeuoCsauB0AAAivSURBVMNnTuzG2QOJSv1sXiiJvVI09VBzWMc6WvRf4xmrk3+8dE2RxrKUrw5jq2BEYi+w2ofvtQpN7IWeg4FR5lsDWKykxC4f4qLOmkpUvNDa1ccJjhoo5ubEiUw+Rd0NalJHTE0WVfl4R0twYV4Gj72fKfVu1nS7dVy9gaZOV0+N6u2yL8hFBDrTxdmfhm7SpalMr/hARdJ8k21K7IajmJ9yrCPfq8h0uMOVe9txRzkZpLtl9Z6AWqQy1A/lDA99Fxy4Doj9K+de4/VJLSb4TVygyAIPnymxR80+pvlDGr9QEnulaOphETcaxuoUHhG47Y894hGVU7MC+j9i+vXUnSDB6qVJR5pRBZyDmm+pqvcgCcqp0F7xyo1akRdh87fyy654oeXXyQmOGijy5iTuhrPQu0HNVTqmJvtFH98WqHT5Hh+x9bDwu9kCb7f8srnprbba1NvlX5ALD3TG+4dwlENxyp/YjXeYjuMsM7H7f8TDE8prEi4+fJHVt281GKrqihVRP4I7T5ccQkc4dCtkCi2m4+gE7uMKPHyFLCo0uzxTXMuRfkKUUamJXV+ddHMptaSwahZROY2roa2lofXU1dpSEnsR56C88soKU6XrQ0mJvdCLcES7Tfkqnlp0nZzgqIEib06iamR4nkA10JStvUqbqoc/WT6y5yNL+D4jvh5G3s0WerslMpPb1s8FvnpqU2+Xf0EuItCZ7h+8LwNaWkIFoTBl7BXvHaRQ389COlGYZ9AuxetLFPjGUa0f4WtcOIuR2OPE14/gt7elJ/aCjqMTOJSVTOzSgnQ3pfq5SOyVUnSv+EKrk1Jc8E9LeRO79rpiWs/qJXbdJmtWjKtiHSjtOfbiL8K+8lc889pZfIKjBoq8OVGOZei8KD2xx9VkqSp7TevB5F5KYjfdzRbcQOJF9uO0dlZbbert8i/IRQU6/f0DLQHLVdbn2NWuN6ED7B0vw1dHgbHGpUg1Ydtx5VIk92Er5BpH58842voR7Cqo+domeKgi+uGoXXk0xzGiX2KBh880WdzsXqXp2GZeUd0cXIYqIKKDTyhjqjdCsdVJuhbo/mhFHPFCO80W1vAXKK1MiT3+HIz9O021rhvLTOzFnzUVrXh1dIKjBoq8OdHcm2iaC+MP7rISuxfZt23T3IJGrEDhd7OF3W5Je4oKXW21qbdluyAXHOg0s/n/JXuVpsxvntM1uKryB6nwBm7tl0zBOhBQcGLXzk0lkkS/JEPd5/L+jDw4mhPWOGlwYXFvnjMmc91UMbMb/qSZ5yLaVErRv+5WYHVSh+v/aJmPuLluhVc04lbMuD6GirftuDaxx4xSlhCbYXTzwGbLbWMv+qwpd8VT1M0Jjhoo8uYk/HWSOklhd4PLS+z+QjSN38YVKPlu1nS7Je8p6nN11ajeLv+CXEigM6ynJtVzt1yKsr8rXs7s5hriz2saG7mUYGu8KKhFfsC9sGucuh5cvIKM9SNwTur6VeaHyROGptMHkhb1RQXyHzn1ahJ/+CJvuqJnN3X7MMzFNahSzNcp4wE0Vyd5HqUBz/hHy1xP5O91OqL+1BmuLYb1jGwVaekYM3VCC4+KOQcNm2w6wWGx5Sb2os+aClQ8VV2c4KiBIm9O1Pa9gNCthvmyt8zEHrypiP7STLPuylL03WQMZ5y6ZqbbG1RUjeqtuoTiL8iFBLrQDYm5Hsdc+KGzzMSOO5x1B13uy4MVw7p6CNiH0wQrB7V9mSK+zEPlUG9RMhI7olhw0HlwATbUQ8B2nCZYOajty0Ngrw3qLUpGYkcUKw66ktn5E7PyWFEPAbtxmmDloLaXLPguKFQV9RYlI7EjCgcdNqAeArE4TbByUNtRj6i3KBmJHVE46LAB9RCIxWmClYPajnpEvUXJSOyIwkGHDaiHQCxOE6wc1HbUI+otSkZiRxQOOmxAPQRicZpg5aC2ox5Rb1GaXC43Pj5e4MQk9pWIgw4bUA+BWJwmWDmo7ahH1FuUZnZ2dmpqqsCJE1evXp2amrp169bi4mJFVwv24OICG1APgVicJlg5qO2oR9RbFCuXy83Ozo6NjS0sLBQ4S8KdbXJyMpVKXQUAAAAAABUwPj4+NTVVeFz3EjsAAAAAALANiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG5HYAQAAAACwEYkdAAAAAAAbkdgBAAAAALARiR0AAAAAABuR2AEAAAAAsBGJHQAAAAAAG/1/y2rNnczrN5sAAAAASUVORK5CYII=" alt="">


2014-03-07 16:14 GMT+08:00 Mayur Rustagi <[hidden email]>:
http://<Master URL>:4040/storage/

Mayur Rustagi
Ph: +1 (760) 203 3257


On Fri, Mar 7, 2014 at 12:09 AM, qingyang li <[hidden email]> wrote:
dear community, can anyone tell me : how to get size of rdd in memery ?
thanks.


Reply | Threaded
Open this post in threaded view
|

Re: how to get size of rdd in memery

qingyang li
addtion :
1. i have run LOAD DATA INPATH '/user/root/input/test.txt' into table b; in shark.  i think this will create rdd in memery, right?
2. when i run “free -g" , the result show somethings has been stored into memery.  the file is almost 4g.

[root@bigdata001 spark-0.9.0-incubating-bin-hadoop2]# free -g
             total       used       free     shared    buffers     cached
Mem:            15          6          8          0          0          4
-/+ buffers/cache:          2         13
Swap:            7          0          7



2014-03-07 16:51 GMT+08:00 qingyang li <[hidden email]>:
in that page, it is empty , it does not show anything.
Here is the picture.




2014-03-07 16:14 GMT+08:00 Mayur Rustagi <[hidden email]>:

http://<Master URL>:4040/storage/

Mayur Rustagi
Ph: +1 (760) 203 3257


On Fri, Mar 7, 2014 at 12:09 AM, qingyang li <[hidden email]> wrote:
dear community, can anyone tell me : how to get size of rdd in memery ?
thanks.



Reply | Threaded
Open this post in threaded view
|

Re: how to get size of rdd in memery

qingyang li
In reply to this post by qingyang li
addtion :
1. i have run LOAD DATA INPATH '/user/root/input/test.txt' into table b; in shark.  i think this will create rdd in memery, right?
2. when i run “free -g" , the result show somethings has been stored into memery.  the file is almost 4g.

[root@bigdata001 spark-0.9.0-incubating-bin-hadoop2]# free -g
             total       used       free     shared    buffers     cached
Mem:            15          6          8          0          0          4
-/+ buffers/cache:          2         13
Swap:            7          0          7



2014-03-07 16:51 GMT+08:00 qingyang li <[hidden email]>:
in that page, it is empty , it does not show anything.
Here is the picture.




2014-03-07 16:14 GMT+08:00 Mayur Rustagi <[hidden email]>:

http://<Master URL>:4040/storage/

Mayur Rustagi
Ph: +1 (760) 203 3257


On Fri, Mar 7, 2014 at 12:09 AM, qingyang li <[hidden email]> wrote:
dear community, can anyone tell me : how to get size of rdd in memery ?
thanks.