Guofei Gu
Note:
- Acceptance ratio: definitely an important metric (maybe the easiest metric that can be quantified), but not the only metric
- Paper quality and impact: how many classic papers are from this conference? how much impact do papers from this conference have on the community? are they well cited and studied?
- Committee member quality: what's the quality of TPC members? are they noted researchers in this area? This is an important factor because they will affect the quality of submission (good papers will prefer to submit to the conference with noted researchers in the committee), and control the quality of accepted papers.
- Attendee/Paper number ratio: another quantified metric. This somehow reflects the influence of this conference on the community
- Location: a beautiful place has some attraction. In addition, many researchers (but not all) are not very willing to travel to other countries due to limited funding or time (or VISA problem...), so they just submit papers to local conferences. Thus, normally the conferences located in USA are better than in Europe, which is also better than in Asia.
- History: a conference with a long history may have a good tradition and reputation
- Industry connection: this somehow reflects the impact on the industry. Normally, conferences on more applied techniques will attract more industry partners (so have more money to improve the quality of conference)
| Tier 1 |
S&P
(Oakland)
|
IEEE Symposium on Security and Privacy |
| CCS | ACM Conference on Computer and Communications Security | |
| Security | USENIX Security Symposium | |
| NDSS | ISOC Network and Distributed System Security Symposium | |
| -- Crypto conferences below -- | ||
| Crypto | International Cryptology Conference | |
| Eurocrypt | European Cryptology Conference | |
| Tier 2 | ESORICS | European Symposium on Research in Computer Security |
| RAID | International Symposium on Recent Advances in Intrusion Detection | |
| ACSAC | Annual Computer Security Applications Conference | |
| DSN | The International Conference on Dependable Systems and Networks | |
| IMC | Internet Measurement Conference | |
| ASIACCS | ACM Symposium on Information, Computer and Communications Security | |
| PETS | Privacy Enhancing Technologies Symposium | |
| EuroS&P | IEEE European Symposium on Security and Privacy | |
| CSF (CSFW) | IEEE Computer Security Foundations
Symposium. Supersedes CSFW (Computer Security Foundations Workshop) |
|
| -- Crypto conferences below -- | ||
| Asiacrypt | International Conference on the Theory and Application of Cryptology and Information Security | |
| TCC | Theory of Cryptography Conference | |
| CHES | Conference on Cryptographic Hardware and Embedded Systems | |
| Tier 3 | SecureComm | Internation Conference on Security and Privacy in Communication Networks |
| CNS |
IEEE Conference on Communications and
Network Security |
|
| DIMVA | GI SIG SIDAR Conference on Detection of Intrusions and Malware and Vulnerability Assessment | |
| ACNS | International Conference on Applied Cryptography and Network Security | |
| SAC | ACM Symposium on Applied Computing | |
| ACISP | Australasia Conference on Information Security and Privacy | |
| ICICS | International Conference on Information and Communications Security | |
| ISC | Information Security Conference | |
| ICISC | International Conference on Information Security and Cryptology | |
| SACMAT | ACM Symposium on Access Control Models and Technologies | |
| IFIP SEC | IFIP International Information Security Conference | |
| WiSec
(WiSe, SASN) |
ACM Conference on Wireless Network
Security Supersedes WiSe (ACM Workshop on Wireless Security) and SASN (ACM Workshop on Security of Ad-Hoc and Sensor Networks) |
|
| SOUPS | Symposium On Usable Privacy and Security | |
| IFIP WG 11.9 | IFIP WG 11.9 International Conference on Digital Forensics | |
| DFRWS | Digital Forensic Research Conference | |
| CODASPY |
ACM Conference on Data and
Application Security and Privacy |
|
| CANS | Cryptology and Network Security conference | |
| -- Crypto conferences below -- | ||
| FSE | Conference on Fast Software Encryption (FSE) | |
| PKC | International Conference on Practice and Theory in Public Key Cryptography | |
| FC | International Conference on Financial Cryptography and Data Security | |
| CT-RSA | RSA Conference, Cryptographers' Track | |
| HOST | IEEE International Symposium on Hardware Oriented Security and Trust | |
| -- Workshops below -- | ||
| HotSec | USENIX Summit on Hot Topics in Security | |
| NSPW | New Security Paradigms Workshop | |
| IH&MMSec | Workshop on Information Hiding and Multimedia Security | |
| IWIA | IEEE International Information Assurance Workshop | |
| Others (Obsolete, or not ranked) | SecDev |
IEEE Secure Development Conference |
| ISPEC | Information Security Practice and Experience Conference | |
| NordSec | Nordic Conference on Secure IT Systems | |
| ICITS | International Conference on Information Theoretic Security | |
| MALCON |
International
Conference on Malicious and Unwanted Software |
|
Note:
| Year | Tier 1 | Tier 2 | Tier 3 | Year | ||||||||||||
| IEEE S&P | ACM CCS | USENIX Security | NDSS | CSF/CSFW | ESORICS | RAID | ACSAC | ASIACCS | IMC | SecureComm | DIMVA | ACNS | SOUPS | DFRWS | ||
| 2022 | 18.1%(256/1414) |
16.2%(94/581) |
19.4%(32/165) |
18.5%(104/562) |
25%(35/139) | 28%(11/39) | 2022 | |||||||||
| 2021 | 12.1%(115/952) | 22.3%(196/879) | 18.7%(246/1316) | 15.2%(87/573) | 25%(43/172) | 20.2%(71/351) | 23.2%(32/138) | 24.5%(80/326) | 18.9%(70/370) | 27%(53/196) | 19.9%(37/186) | 2021 | ||||
| 2020 | 12.4%(104/841) | 16.9%(121/715) |
16.1%(157/977) |
17.4%(88/506) | 25%(29/116) |
25.6%(31/121) | 23%(70/302) | 21.8%(67/308) | 24.5%( 53/216) | 29%(13/45) |
2020 |
|||||
| 2019 |
12%(84/679) |
16%(149/934) |
15.5%(113/729) | 17%(89/52)1 | 34%(30/89) |
19.4%(67/344) |
22%(37/166) |
22.6%(60/266) |
17%(44/258, regular paper) |
20%(39/197) |
25.5%(38/149) |
28.8%(23/80) | 2019 |
|||
| 2018 |
11.5%(63/549) |
16.6%(134/809) |
19.1%(100/524) |
21.5%(71/331) |
35%(25/72) |
22.8%(33/145) |
20%(60/299) |
16.8%(52/310) |
24.7%(43/174) |
|
21%(28/132) |
2018 |
||||
| 2017 |
13%(60/457) |
17.9%(151/843) |
16.3%(85/522) |
16%(68/423) |
34%(32/94) |
16%(54/338) |
20%(21/105) |
19.7%(48/244) |
18.7%(67/359) |
23.4%(42/179) |
22.8%(34/149) |
27%(26/98) |
2017 |
|||
| 2016 |
13.3%(55/413) |
16.5%(137/831) |
15.6(72/463) |
15.4%(60/389) |
35.6%(31/87) |
21%(60/285) |
25%(21/84) |
22.8%(48/210) |
21%(73/350) | 25%(46/184) |
31.8%(21/66) |
19%(35/183) |
28%(22/79) |
2016 |
||
| 2015 |
13.5%(55/407) |
19.8%(128/646) |
15.7%(67/426) |
16.9%(51/302) |
34%(35/102) |
20%(59/293) |
23.5%(28/119) |
24.4%(47/193) |
17.8%(48/269, regular), 23%(62/269) | 26%(44/169) |
28%(30/108) |
22.7%(17/75) |
21% (33/157) |
24%(22/93) |
34.8%(16/46) |
2015 |
| 2014 |
13%(44/334) |
19.5%(114/585) | 19%(67/350) |
18.6%(55/295) |
35%(29/83) |
24.8%(58/234) |
19.4%(22/113) |
19.9%(47/236) |
19.6%(50/255) | 22.4%(43/192) |
27.6%(27/98) |
23.3%(14/60) |
22.5%(33/147) |
26%(21/80) |
28.8%(15/52) |
2014 |
| 2013 | 12%(38/315) |
19.8%(105/530) | 15.9%(44/277) |
18.8%(47/250) | 26%(19/73) |
17.8%(43/242) |
23.1%(22/95) |
20%(34/171) |
16%(35/216,regular) 28%(61/216) |
23.6%(42/178) | 37%(26/70) |
31.6%(12/38) |
23.3%(35/150) |
29.4%(15/51) |
26.5%(13/49) |
2013 |
| 2012 | 13%(40/307) | 18.9%(80/423) | 19.4%(43/222) | 18%(46/258) | 24.8%(25/101) |
20.2%(50/248) |
21%(18/84) |
19%(44/231) | 22%(35/159,regular) 30.8%(49/159) |
24.6%(45/183) | 28.8%(21/73) | 31%(14/45) | 17.2%(33/192) |
21%(14/67) |
29.8%(14/47) | 2012 |
| 2011 | 11%(34/306) | 14%(60/429) | 17%(35/204) | 20%(28/139) | 26%(21/81) | 23.2%(36/155) | 23%(20/87) | 20%(39/195) | 16%(35/217,regular) 27.6%(60/217) |
19%(42/220) | 35.8%(23+11/95) | 31.7%(13/41) | 18%(31/172) | 33%(15/45) | 22.5%(14/62) | 2011 |
| 2010 | 11.6% (31/267) | 17.2%(55/320) | 14.9%(30/202) | 15.4%(24/156) | 28%(23/81) | 20.8%(42/201) | 23%(24/104) | 17%(39/227) | 15% (25/166) | 22%(47/211, both short and full) | 25%(28/112) | 34%(12/35) | 18%(32/178) | 24.6%(16/65) | 41%(16/39) | 2010 |
| 2009 | 10% (26/253) | 18.4%(58/315) | 14.7%(26/176) | 11.7% (20/171) | 23.6%(22/93) | 19.1%(42/220) | 28.8%(17/59) | 19.6%(44/224) | 22.4% (33/147, regular) 27% (40/147) |
22.4%(41/183, both short and full) | 25.3%(19/75,full paper) 34.7%(26/75) |
29.5%(13/44) | 21% (32/150) | 30.6%(15/49) | 37.5%(15/40) | 2009 |
| 2008 | 11.2% (28/249) | 18%(51/281) | 15.9% (27/170) | 17.8% (21/118) | 18%(21/115) | 22%(37/168) | 25%(20/80) | 24%(42/173) | 17.6% (32/182,regular) 22.5% (41/182) |
17.3%(32/185,both short and full) | 21%(26/124) | 33%(14/42) | 22.9%(30/131) | 30%(13/43) | 39.5%(17/43) | 2008 |
| 2007 | 8% (20/246,full paper) 12% (29/246) |
18% (55/303) | 12.3% (23/187) | 14.4% (18/125) | 25%(25/101) | 23.8%(39/164) | 18% (18/100) | 22%(42/191) | 18.3% (33/180,regular) 29.4% (53/180, including short paper) |
24.4%(21/86, full paper) | 26%(31/119) | 24.6%(14/57) | 12% (31/260) | 29%(12/41) | 47.2%(17/36) | 2007 |
| 2006 | 9.2% (23/251, full paper) 12.7% (32/251) |
14.8%(38/256) |
12.3% (22/179)
|
13.4% (17/127) | 24.5%(25/102) | 20%(32/160) | 17% (16/93) | 30%(40/134) | 17.7% (33/186) Start from 2006 | 21% (19/92, full paper track) | 25.4%(32/126) | 26.8%(11/41) | 15.1% (33/218) | 36%(14/39) | 44.4%(16/36) | 2006 |
| 2005 | 8.9% (17/192) | 15.2% (38/250) | 14.8% (22/149) | 12.9% (16/124) | 20.8% (20/96) | 17.0% (27/159) | 20.5% (17/83) | 22.8% (45/197) | 27% (22/82, full paper) | 22.2% (32/144, full paper) 36.1% (52/144) Start from 2005 |
27%(14/51) | 22.2% (35/158) | 26%(10/39) | 2005 | ||
| 2004 | 10.2% (19/186) | 13.9% (35/251) | 12.0% (22/184) | 16.3% (16/98) | ? (20/?) | 17.0% (27/159) | 13.5% (16/118) | 26.1% (35/134) | 19% (19/98,full paper) | 34%(14/41) Start from 2004 |
12.1% (36/297) | 2004 | ||||
| 2003 | 14.5% (19/131) | 13.8% (35/253) |
16.4% (21/128)
|
20.5% (17/83) | ? (17/?) | 16.7% (19/114) | 29.5% (13/44) | 30%(60/119) |
26% (19/73, full paper) | 16.8% (32/191) Start from 2003 |
2003 | |||||
| 2002 | 22.1% (21/95) | 17.6% (27/153) | 16.9% (22/130) | 19.0% (15/79) | 27.4% (23/84) | 19.3% (16/83) | 25.0% (16/64) | 32.3%(33/102) | 24% (15/62, full paper) | 2002 | ||||||
| 2001 | 17.8% (19/107) | 17.6% (27/153) | 28.9% (24/83) | 24.2% (16/66) | 38.9% (21/54) | not held | 21.8% (12/55) | 31.9%(38/119) |
26% (14/53), Start from 2001 | 2001 | ||||||
| 2000 | 13.1% (18/137) | 21.2% (28/132) | 20/? | 29.4% (15/51) | 45.8% (22/48) | 25.3% (19/75) | 53.8% (14/26) | 42%(42/100) | 2000 | |||||||
| 1999 | 24.6% (15/61) | 19.3% (16/83) | 27%(18/67) | 40.4% (19/47) | not held | ? (32/?) | 1999 | |||||||||
| 1998 | 16.4% (19/116) | 20.0% (17/85) | 27.7%(18/65) | 33.3% (15/45) | 40.4% (23/57) | 67.3% (35/52) Start from 1998 |
1998 | |||||||||
| 1997 | 18.2% (20/110) | 26.6% (17/64) | not held | 13/? | not held | 1997 | ||||||||||
| 1996 | 29.9% (20/67) | 32.2% (19/59) | 21/? | 14/? | 36.2% (21/58) | 1996 | ||||||||||
| 1995 | 27.8% (20/72) | not held | 21/? | not held | 1995 | |||||||||||
| 1994 | 29.2% (19/65) | 44.3% (31/70) | not held | 15/? Start from 1994 |
36.6% (26/71) | 1994 | ||||||||||
| 1993 | 24.3% (17/70) | 45.0% (27/60) Start from 1993 |
13/? | not held | 1993 | |||||||||||
| 1992 | 23.6% (21/89) | 27/? |
? (24/?) | 1992 | ||||||||||||
| 1991 | 30.4% (28/92) | not held |
not held | 1991 | ||||||||||||
| 1990 | ?(34/?) | 25/? | ? (?/?) Start from 1990 |
1990 | ||||||||||||
| 1989 | ?(30/?) | not held | 1989 | |||||||||||||
| 1988 | ?(26/?) | Start from 1988? | Start from 1988 | 1988 | ||||||||||||
| 1987 | ?(26/?) | 1987 | ||||||||||||||
| 1986 | 27.5% (25/91) | 1986 | ||||||||||||||
| 1985 | 39.7% (25/63) | Start from 1985 | 1985 | |||||||||||||
| 1984 | 64.1% (25/39) | 1984 | ||||||||||||||
| 1983 | 67.6% (23/34) | 1983 | ||||||||||||||
| 1982 | 55.9% (19/34) | 1982 | ||||||||||||||
| 1981 | ?(18/?) | 1981 | ||||||||||||||
| 1980 | 100% (19/19) Start from 1980 |
1980 | ||||||||||||||
Thanks the following people for information and suggestions/comments on the ranking and statistic: Kevin Almeroth, Marco Balduzzi, Kevin Borgolte, Billy Brumley, Kevin Butler, Juan Caballero, Michele Campobasso, Yinzhi Cao, Jihyuk Choi, Nicolas Christin, Mihai Christodorescu, John Clemens, Ton van Deursen, Sven Dietrich, David Evans, Clement Fung, Simson Garfinkel, Edy Glatz, Payas Gupta, J. Alex Halderman, Ragib Hasan, Thorsten Holz, Muhammad Ikram, Ashar Javed, Chang-han Jong, Paul A. Karger, Jonathan Katz, Brian Levine, Yuhang Lin, Zhiqiang Lin, Martin Andreoni Lopez, Peter Mell, Weizhi (Yuxin) Meng, Antonis Michalas, Abedelaziz Mohaisen, Lukasz Olejnik, Hamed Okhravi, Mert D. Pesé, Christina Pöpper, Juan D. Parra Rodriguez, Christian Rossow, Kent Seamons, Monirul Sharif, Jaryn Shen, Ivo Sluganovic, Robin Sommer, Chao Yang, Vinod Yegneswaran, Zhiyuan Zheng, Jianying Zhou, Thomas Zimmermann, ... and you.