Why did we create CloudMagic Gmail Search Extension?

Rohit Nadhani

Why did we create CloudMagic?

This is the first blog post from CloudMagic team and I guess it is the right place to answer this question.

We are increasingly using a large number of cloud-based services every day. For example – our own company does not have a single copy of MS Office and we use Google Apps for Domains extensively. With the prevailing use of online applications, we felt a need to search and locate stuff quickly. Similar to how Mac’s Spotlight and Windows 7 Search can search within your local data. While Google provides great search features for Gmail and Google Docs, it is not as fast as desktop search — neither it provides unified search results across multiple services.

We love Spotlight‘s search experience and we wanted the same experience for all of our data residing on the cloud.

We created CloudMagic to provide lightning-fast, “search as you type” functionality for your online data.

How does it work?

CloudMagic creates a search index of your online data on your local hard disk. Only the relevant text data is indexed so the size of the index is only a fraction of your total data. For example, we don’t index attachments, images or any binary (non-text) data.

Think of CloudMagic as a software-only equivalent of Google Search Appliance for your online data.

CloudMagic automatically updates the search index as long as the browser is running. You don’t need to keep the web-pages of the various online services open to update the search index. You can continue browsing other websites while the index gets updated in the background.

Since CloudMagic indexes the data completely in your hard-disk, you don’t need to store or transfer passwords with any 3rd party servers — including ours.  Now that hard drive space has become so cheap, keeping a search index in your hard-disk is no longer a real concern.

Which services are supported today?

We are launching CloudMagic today with support for Gmail. Google Docs support is a few weeks away. For those of you having multiple Gmail accounts, CloudMagic also searches between multiple accounts and presents a unified view of search results.

If you like what we are doing, let us know your comments. Also, please help us determine our roadmap.

Which online data sources would you like us to support on priority?

Please leave your comments below or start a discussion thread at our Community Forums.

Cheers,
Team CloudMagic


Comments

  1. Ryan D
    August 23rd, 2010 | 10:11 pm

    Is a plugin for IE in the works?

  2. August 23rd, 2010 | 10:17 pm

    Yes!

  3. Planktno
    August 23rd, 2010 | 10:24 pm

    Why don’t you upload your extension to the official extension sites?

  4. August 23rd, 2010 | 10:27 pm

    We wanted to launch at TechCrunch & then announce it everywhere else. We launched today.

  5. Paul
    August 23rd, 2010 | 11:22 pm

    Really digging the extension. Much better than default gmail search. One suggestion: Have a quick link/button on email results to reply/forward/etc.

  6. Om
    August 23rd, 2010 | 11:38 pm

    Liked it!

  7. August 24th, 2010 | 12:07 am

    Google Reader, please, preferably with de-duplication and clustering built into the results.

  8. Mxx
    August 24th, 2010 | 12:23 am

    continuing conversation from http://techcrunch.com/2010/08/23/cloudmagic/#comment-1203168
    yes, you might not be limited to just gmail, you’ll support hotmail, yahoo, etc..but still it seems like you can survive only for as long as sites you’ll be indexing don’t natively implement this.

    also, if you use Thunderbird or Outlook or osx mail or win7 mail, all of them expose content of your email to OS-native indexing, possibly faster/more efficient than your solution..

  9. August 24th, 2010 | 2:38 am

    Hello guys
    1°) can you tell us how you earn money out of cloudmagic ? Nothing is explained on your site
    2°)does the plugin upload data on your servers ?
    Thanks for your answers

  10. August 24th, 2010 | 3:21 am

    Great, great, great idea!

    I would love if you could integrate index & search on my Dropbox account.

    Thanks guys,

    Ivan

  11. ammi
    August 24th, 2010 | 3:39 am

    i hope we could use cloud magic soon on Linux also….

  12. Richard
    August 24th, 2010 | 4:34 am

    Any hopes of a Safari Extension?

  13. Zhenmao
    August 24th, 2010 | 6:17 am

    It works like magic :D But why do the results under contacts are different from my google contacts?

  14. August 24th, 2010 | 6:37 am

    what about for Firefox and other browsers?

  15. Team CloudMagic
    August 24th, 2010 | 7:18 am

    Currently we support Firefox and Chrome. IE support is coming.

  16. David McGuigan
    August 24th, 2010 | 8:12 am

    In the past few weeks I’ve had multiple conversations with friends about how ridiculously slow Gmail search is. YOU GUYS JUST ROCKED MY WORLD!!!!

    It would be so incredible if:
    1. You made the overlay exactly as wide as the built in Gmail search field and button so I could just cover it up completely. and
    2. You integrated this with Spotlight instead of the browser. Being able to use Spotlight for this would BE INCREDIBLE.

    Again thank you so so so much for this, I would gladly pay for it ( especially if it were Spotlight driven ).

    David McGuigan

  17. August 24th, 2010 | 8:33 am

    [...] yang dijelaskan di blog CloudMagic, produk ini dibuat terinspirasi oleh hasil pencarian yang ada pada layanan Spotlight pada Mac atau [...]

  18. MarkG
    August 24th, 2010 | 8:47 am

    Where is the index stored? Is it local to my HD, or do you store it online somewhere? If you store it online, then why should I trust you? My email most likely contains things I dont want you to see? Also, I assume you would answer with a policy against peeking, but you’ll likely get purchased and then what? Policies can change. Sorry to sound negative, I really like the idea and the implementation, but you ask for alot of control.

  19. August 24th, 2010 | 9:47 am

    @MarkG

    CloudMagic stores the index locally on hard-disk (like Thunderbird, Outlook). Your credentials are never sent to any servers apart from Gmail’s servers.

    So you are *not* handing CloudMagic servers your account credentials under any circumstances!

  20. August 24th, 2010 | 9:53 am

    @David:

    1. Good idea. Both Google Search and CloudMagic Search have its own advantages & disadvantages. CloudMagic search box is non-intrusive so you could keep them both without getting distracted. However, we might provide an option to replace the default search in the future.

    2. If you want your email search results to be integrated with Spotlight, then it is best to use Apple Mail client and download your mails using POP/IMAP, IMHO. In the future, CloudMagic is going to support many more services. Think “Spotlight for all of your online data”.

  21. August 24th, 2010 | 9:55 am

    @OlivierSeres

    1) Freemium Model.
    2) No. Both credentials & index are stored locally.

  22. August 24th, 2010 | 9:56 am

    @Shyam Somanadh

    Threaded conversations is coming soon.

  23. August 24th, 2010 | 9:59 am

    @Mxx

    As I said earlier, it is not limited to mail. For example, it could index SalesForce data in the future.

    Another reason to use CloudMagic is that it will provide unified search results across multiple services.

  24. August 24th, 2010 | 10:00 am

    @Paul

    Sure. We thought we should reduce the overlap between CloudMagic & Gmail functionality unless we can significantly improve the existing Gmail feature.

  25. itisbasi
    August 24th, 2010 | 10:12 am

    Brilliant extension! Please make the extension for linux platform. Why the step-motherly treatment for linux when you have come out with the extension for windows and mac.

  26. Larry
    August 24th, 2010 | 10:30 am

    Looks great. Please make a version for Linux.

  27. Ross Regabliati
    August 24th, 2010 | 1:14 pm

    The great thing about switching all our family computers to Linux two years ago was the fact that we are so browser based and very dependant on Firefox extensions which are usually pretty OS agnostic.

    An extension that works under Linux would be appreciated.
    (because I aint going back to the other OS after using it for over 2 decades!)

  28. Winsem
    August 24th, 2010 | 2:39 pm

    Are there plans to index/search some other Google Clouds also? Like the Calendar and Google Docs? It would be *very* handy to be able toe serach them along Gmail in one search!

  29. August 24th, 2010 | 2:52 pm

    @Winsem,

    Yes we will add more services gradually. Docs support is high priority right now.

  30. Chris
    August 24th, 2010 | 3:20 pm

    Hi

    Could you please make the extension work for linux? As soon as you do, I can trial it, then deploy it to all the windows based PCs in our company.
    Cheers

  31. Robert Zemeckis
    August 24th, 2010 | 6:04 pm

    Brilliant idea! it works great.

    I was wondering if HTTP proxy support will be supported in the future. I know HTTPS is there, but some corporate proxies only provide HTTP.

  32. August 24th, 2010 | 6:25 pm

    The question was already asked but not answered. Any plans for a Safari extension soon?
    Great work, guys.
    Thanks

  33. August 24th, 2010 | 7:03 pm

    @Spalay,

    IE/Linux support is high on Priority. Next is Safari.

  34. August 24th, 2010 | 7:13 pm

    @Robert:

    You have just discovered a minor UI bug. The caption for Proxy Settings should be HTTP and not HTTPS :) So go ahead and use it with HTTP proxy. We will fix the typo in the next release.

  35. Charles
    August 25th, 2010 | 8:10 am

    fantastic extension!!
    but recently i found out that cloud magic is effecting my other google chrome extension “gmail checker” (notify new emails).
    somehow i need to reload my gmail in order to let it responds, is it because of cloud magic or gmail checker??
    i ve filed a post on their side too
    thx

  36. iMac
    August 25th, 2010 | 8:16 am

    Worked fine on Windows.

    But, when I installed it on the iMac, it corrupted Firefox 3.6.8.

    Firefox crashed and would not reopen. Could not rebuild the profile and had to delete everything. Did a fresh reinstall of Firefox and then installed Cloudmagic again to see if it was the culprit. Guess what… crashed again.

    I’m bummed because it I had an extensive Firefox profile. Rebuilding…but, not reinstalling Cloudmagic.

  37. maming
    August 25th, 2010 | 8:40 am

    If CM support searching the local files, that would be great more!

  38. Luca
    August 25th, 2010 | 9:57 am

    Guys, great stuff.

    Suggestion for killer feature: index / search / sort ability for Size of Attachment. Would allow deleting emails with large attachments to free up space in Gmail. Something that is so easy in Outlook and impossible (so far) in Gmail.

    thanks!!

  39. August 25th, 2010 | 11:10 am

    @Charles,

    We will check CM with Gmail Checker and update here.

  40. August 25th, 2010 | 11:14 am

    @iMac,

    Sorry for disappointing you. Seems like you have hit a bug in CM.

    Would you be interested in helping us nail the bug? We would be grateful if you can contact us at feedback@cloudmagic.com.

  41. August 25th, 2010 | 11:19 am

    @Luca,

    Thanks for your feedback. Added to our wishlist :)

  42. August 25th, 2010 | 3:55 pm

    Can i choose data base path, so i can use it on my usb stick? I use Firefox (and Chrome, but no so often, only for online vieos) “portable version” from here
    http://stadt-bremerhaven.de/
    Please make an option/update so portable app users can use it on the stick.

  43. August 25th, 2010 | 3:57 pm

    the usb tools are here
    http://stadt-bremerhaven.de/category/portable-programme/
    sorry, its only german language

  44. August 25th, 2010 | 7:58 pm

    I’m waiting for Linux version too. I hope you can develop it soon, why the addon isn’t in firefox addons site?

  45. August 25th, 2010 | 8:10 pm

    @coriandreas

    We don’t provide the option to change the path currently. We might implement this in the future. Thanks for writing!

  46. Stephen
    August 26th, 2010 | 12:24 am

    Wow, this is great. I cant wait till you expand to google docs also. I love when people boycot traditional desktop software (ms office) for cloud based stuff (Gdocs) :)

  47. Sven
    August 26th, 2010 | 1:42 am

    I would love to see my Dropbox account integrated with CloudMagic as well. Would love to hear if and when this is on your agenda.

    Other than that – a fantastic extension !

  48. August 26th, 2010 | 6:10 am

    I started using Cloud Magic today and already I can’t see myself using Gmail without it. This is a great plugin!

    I look forward to your future updates.

    Karl

  49. Dale
    August 26th, 2010 | 7:22 am

    It would be nice if the proxy (when not found) could fail softly back to a direct connection. I would venture to guess that the majority of proxy users are behind a corporate firewall, but when they get home that proxy does not exist. If I could take my laptop home and not have to reconfigure CloudMagic at each location change that would be a bonus. Cheers!

  50. August 26th, 2010 | 9:23 am

    @Sven

    We are going to support additional services soon. Google Docs is next.

  51. August 26th, 2010 | 9:23 am

    @Karl,

    That makes us super-happy!

  52. August 26th, 2010 | 9:24 am

    @Dale:

    Very valid request. We will definitely implement this shortly.

  53. Ravi Kiran
    August 26th, 2010 | 1:27 pm

    Can you provide the plug-in of the same for Internet Explorer also.

  54. August 26th, 2010 | 4:43 pm

    I really like CloudMagic, but my FireFox now opens with the CloudMagic welcome page http://www.cloudmagic.com/welcome.php?s=n.
    Why is that?
    And, more important, how do I turn that off????

  55. Team CloudMagic
    August 26th, 2010 | 5:22 pm

    @Nick Lame

    Seems like you have hit a bug in cloudMagic.

    Would you be interested in helping us nail the bug? We would be grateful if you can contact us at feedback@cloudmagic.com.

  56. Nitin
    August 26th, 2010 | 11:55 pm

    OS: Snow Leopard (10.6.4)
    Browser: Chrome (5.0.375.127)
    Problem: Restarting the browser, the CM search box is dislocated to some place below the gmail search box covering some links on the gmail home page. Would love it if CM search box could remember where I had placed it last time before closing the browser

  57. August 27th, 2010 | 12:07 am

    @Nitin,

    The search box is draggable.

  58. Javier Bonnemaison
    August 28th, 2010 | 12:33 am

    Great stuff. Thanks and keep up the good work.

  59. Aayush
    August 28th, 2010 | 5:40 am

    Great product…when I search for a contact, sometimes, I want to get to their info, not necessarily their emails so I can copy the email or phone number. It would be uber cool if you integrate with Google call phone. For example, if I search for a contact and it has a number attached to them, then a call icon should appear next to their name and clicking it should start the call using the google call phone feature

  60. August 30th, 2010 | 6:48 pm

    so what did you do, before creating this product, that required such an intensive use of GMail and google apps? looks like a chickend and egg problem

  61. August 30th, 2010 | 7:13 pm

    @victor

    The company behind CloudMagic – http://www.webyog.com has been using Gmail & Google Apps internally for several years :)

  62. Norbert
    August 31st, 2010 | 12:23 am

    Thanks for the great search tool. I have also an aol account. When can I search that account which this tool?

  63. Norbert
    August 31st, 2010 | 12:25 am

    I get this code: Unable to download mails
    Error: Invalid credentials a18if6595933eei.35

  64. September 1st, 2010 | 4:47 pm

    @Norbert

    This error comes when you have given incorrect email-id or password in CM.
    You can ‘try add’ account with correct email credentials.

    If the problem persists then please send the ‘cloudmagic.log’ file to feedback@cloudmagic.com (Check this forum post to find path to your logfile http://community.cloudmagic.com/index.php?/topic/30-results-problem/page__view__findpost__p__122)

    HTH
    Parimal Das

  65. Ose
    September 2nd, 2010 | 8:14 pm

    Can you make the search box a little smaller or give the ability to minimize it? It takes up too much space if the screen is not big or the window is not fully enlarged.

  66. Paul Hertz
    September 18th, 2010 | 8:28 pm

    Great product. I have 2 CloudMagic accounts: a personal Gmail and a Google Apps business email. I would like to be able to search the business email and not have my personal emails show up and vice versa – is this possible?

    Also, I have a Syncplicity account (which is connected to Google Docs but I don’t have all my files in Google Docs – they are all in Syncplicity). Is there any future thoughts about searching Syncplicity? (I know people asked this for Dropbox).

  67. September 18th, 2010 | 8:46 pm

    @Paul,

    Accounts-wise filtering is a popular request. We will implement it very soon.

  68. JohnT
    September 19th, 2010 | 12:58 am

    Great product. For Google Docs, is the plan to provide search results across an entire google apps domain, or just a user’s own documents? Hopefully, the search/index will be with all docs owned and shared with the searcher.

    Also, I agree with earlier comments that it would be very useful to reply to an e-mail without the need to reload the browser window, and a Google Voice call button on the contacts results would be totally awesome.

  69. September 20th, 2010 | 10:32 am

    @Ose

    We have recently released CM 1.16 which is resizable.
    Hope this will solve your issue.
    You can read more about 1.16 here:
    http://blog.cloudmagic.com/2010/09/16/cloudmagic-gmail-instant-search-extension-1-16-released-2/

  70. September 20th, 2010 | 10:46 am

    @JohnT

    The Google Docs search will work for documents owned by you and shared to you.
    We have added the “Google Voice call button” for contacts in our wishlist.

  71. September 20th, 2010 | 10:55 am

    @Paul

    While implementing Dropbox, we will surely look into possibilities with Syncplicity.

    Parimal

  72. venki
    September 25th, 2010 | 5:14 pm

    Awesomeness!!!!

  73. nitesh
    October 5th, 2010 | 4:18 pm

    I would really love having advanced search capabilities like gmail search.
    Search/Filter via labels,From,To, Date ect.

  74. Team CloudMagic
    October 5th, 2010 | 4:54 pm

    @Nitesh

    Few of these are already supported, check here (http://cloudmagic.com/advanced_search_operators.php)

    Thanks
    Parimal Das

  75. October 11th, 2010 | 6:17 pm

    I am facing few issues with clouding magic it is not synchronizing or updating the Gmail properly please find the screen shots

    Thanks
    Vimal

  76. Team CloudMagic
    October 11th, 2010 | 6:33 pm

    @Vimal

    We have not received any screen-shots here.
    Can you please send the screen-shots and cloudmagic.log file to “feedback@cloudmagic.com”.

    You can know more about logfile here: http://community.cloudmagic.com/index.php?/topic/41-where-is-cloudmagiclog-file-stored/

    Thanks
    Parimal Das

  77. October 21st, 2010 | 5:30 pm

    Guys

    We have released CloudMagic for Linux.
    You can get it from here: http://cloudmagic.com/downloads.php

  78. Dios li
    October 27th, 2010 | 10:47 am

    Thanks for the magic! It works like a charm. Hope it will support Google Calendar soon! Go Go Go!

  79. October 27th, 2010 | 11:39 am

    @Dios,

    Glad you liked it. Google Calendar is in our wish-list. Google docs coming within a couple of weeks.

  80. Slava33
    November 15th, 2010 | 11:22 am

    Search works great! But why does the Chrome extension ask for access to “all data on your computer”?

  81. November 15th, 2010 | 2:00 pm
  82. Afterburned
    December 8th, 2010 | 7:56 pm

    Brilliant app!
    For the future – Google calendar please!
    Also to think about – the lack of trash bin to recover deleted Google Calendar items – what is your organisations work around?

  83. Gagan
    December 21st, 2010 | 11:48 am

    Super Cool stuff!
    Why don’t you have a link on this website from where I can recommend it to my friends and colleagues.

  84. Chirag
    December 21st, 2010 | 12:09 pm

    @Afterburned

    Thanks for the feedback. Added Google Calendar search to wish-list. Integrated Mail, Docs & Contacts search will be out soon.

    Personally I never felt the need of trash bin for Google Calendar. May be its got to do with my limited usage of Calendar.

    Cheers,
    Chirag
    Team CloudMagic

  85. Chirag
    December 21st, 2010 | 12:20 pm

    @Gagan,

    You’ll find the share links in the application.

    As far as I can remember we thought of adding share links to the site & couldn’t arrive at a consensus on its placement. Your comment will get us started again. Thanks.

    Cheers,
    Chirag
    Team CloudMagic

  86. January 3rd, 2011 | 10:53 pm

    is work in google chrome also?

  87. January 4th, 2011 | 11:18 am

    @Shailesh,

    Yes, CloudMagic works on Google Chrome also.

    Regards,
    Chirag
    Team CloudMagic

  88. IE Lover
    January 28th, 2011 | 11:29 pm
  89. February 1st, 2011 | 7:45 pm

    @IE Lover,

    IE support is in our wish-list.

    Regards,
    Chirag
    Team CloudMagic

  90. February 3rd, 2011 | 3:35 pm

    [...] more platforms & more browsers. It couldn’t have been where it is without your continued support & feedback. Thanks for all the love. Twitter & Facebook support is coming [...]

  91. JK
    February 6th, 2011 | 4:44 pm

    Love this app.

    Facebook Page support would be absolutely awesome.

  92. mel
    February 8th, 2011 | 6:39 am

    Would love to be added Dropbox and Zoho.
    And also the possibility to choose the location of data. So it will be used with PortableFirefox.
    Thanks

  93. February 10th, 2011 | 6:20 pm

    @JK,

    Yes. Facebook & Twitter support is the next thing to come.

    @mel,

    Adding support for Dropbox & Zoho to the wishlist. We already have “possibility to choose the location of data” in wishlist. +1 for it.

    Regards,
    Chirag
    Team CloudMagic

  94. Tim
    April 13th, 2011 | 6:56 pm

    Would be great if you could search RSS feeds I subscribe to as well. Great App!!

  95. Team CloudMagic
    April 13th, 2011 | 7:03 pm

    @Tim
    Thanks. We will include this in future CM releases.

    -Parimal

  96. April 20th, 2011 | 12:54 pm

    Hi Guys,

    I would love this as an App for my android device, and as an option of imap email, even in some of the online versions then this would be truly be email heaven >:¬}

  97. Team CloudMagic
    April 20th, 2011 | 12:58 pm

    @Alex

    Thanks. Android support is not in near horizon, but we are working on an online version.
    You can expect it soon :)

    -Parimal Das

  98. sk
    May 4th, 2011 | 12:48 am

    how about indexing evernote? and linkedin. that would be very useful. thanks

  99. manoj
    May 4th, 2011 | 10:54 am

    @sk
    Facebook & Twitter support is the next thing to come. Linkedin and Evernote are already in our wishlist.

  100. May 26th, 2011 | 4:36 pm

    [...] Nadhani, founder of CloudMagic – the instant search engine for GDocs and GMail – gives us a profound insight into the [...]

  101. Tim
    June 23rd, 2011 | 4:09 am

    Please, please get an update for firefox 5 – i miss my CloudMagic -

  102. Team CloudMagic
    June 23rd, 2011 | 2:39 pm

    Tim,

    The latest version of CloudMagic (i.e v2.70) supports Firefox 5.0.

    You can download the latest version of CloudMagic from this website
    http://cloudmagic.com/

    If you are still facing any problems you can get back to us.

  103. June 29th, 2011 | 2:05 am

    This looks great. I have a lot of stuff on the cloud. But I also have a large archive of older files on my hard disk. It is unlikely I will copy all my old files to the cloud.

    Could cloudmagic also search my hard disk for me – like Google Desktop used to?

    That would be awesome

    Thanks

  104. June 29th, 2011 | 10:37 am

    Pete,

    Thanks for your feedback. To be honest, we haven’t thought about it. Our primary focus is to index cloud data.

    Cheers,
    Chirag
    Team CloudMagic

  105. Jamais
    November 22nd, 2011 | 5:13 am

    Hi! can you really emprove cloudmagic by adding partial recognition

    simple example – i have several tel.numbers across my emails but remember only 4 to 5 last or inner digits in sequence.

    unfortunately nor cloudmagic nor gmail doesn’t provide this feature
    both gmail and your app returns matching results only for first digits in sequence
    https://mail.google.com/support/bin/answer.py?hlrm=ru&answer=6593

    Gmail doesn’t recognize special search characters like square brackets, parentheses, currency symbols, the ampersand, the pound sign, and asterisks. It also doesn’t recognize partial or similar matches, so a search for travel will find travel, but not travels, traveler, or travle.

  106. Team CloudMagic
    November 28th, 2011 | 3:00 pm

    Hi,

    CloudMagic supports partial search. For ex: Searching for “123” will bring “123456”, “12309872” but not “987123” or “8612348” . Similarly searching for “travel” will find “travels”, “traveling” and “traveler”.

    In contact, we look for numbers in the beginning and not in the middle or at the end. Searching in beginning, middle and at the end of a number or a string will bring in a lot of results.
    Prefix search is the most natural one.

    We do not have any plans of supporting middle content and postfix search.

  107. January 11th, 2012 | 6:50 pm

    [...] personal data on different services, with the same ease and speed of Spotlight? That’s when we introduced CloudMagic. In that pursuit, we continued development on CloudMagic – we added more services, we [...]

Leave a reply